00000001:02000400:2.0F:1788305273.132959:0:3302:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788305293.771146:0:3523:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1788305295.726128:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 671 MB/s 00000001:01000000:2.0:1788305295.976366:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 707 MB/s 00000001:01000000:2.0:1788305296.225327:0:3586:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4131 MB/s 00000020:02000000:1.0F:1788305296.845464:0:3615:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_44_g3acc781 00000400:02000000:3.0:1788305297.743593:0:3631:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.155@tcp [8/256/0/180] 00008000:02000000:0.0:1788305301.956053:0:3780:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788305366.545100:0:5746:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788305380.281120:0:6496:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788305380.281127:0:6496:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788305380.281128:0:6496:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788305380.281247:0:6496:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000d85a7a99 00000080:02000400:2.0:1788305380.281258:0:6496:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788305380.298321:0:6496:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788305380.298336:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788305380.298722:0:6496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000dd4849e6) 00000020:00000080:0.0:1788305380.298742:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788305380.396782:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788305380.396898:0:6496:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:3.0:1788305380.426146:0:6496:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788305380.426570:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788305380.426578:0:6496:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788305380.426590:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6052fc5 00000020:01000004:3.0:1788305380.426597:0:6496:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788305380.426602:0:6496:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788305380.426606:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d85a7a99 from MGS 00000020:01000004:3.0:1788305380.426611:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788305380.426880:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d4f61aa3) 00000020:00000080:3.0:1788305380.426894:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788305380.427077:0:6496:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d85a7a99 from MGS, refs=2 00080000:01000000:3.0:1788305380.427084:0:6496:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788305380.427089:0:6496:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6052fd3 00000100:00100000:3.0:1788305380.427196:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788305380.427845:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788305380.427850:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788305380.428754:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788305380.428763:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788305380.429910:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305380.430101:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788305380.430106:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788305380.431024:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788305380.431033:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788305380.431446:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788305380.431452:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788305380.432159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305380.432162:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305380.432164:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305380.432583:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305380.432586:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305380.432588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305380.433236:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788305380.436020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788305380.683522:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2585 MB/s 00000001:01000000:1.0:1788305380.940635:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3182 MB/s 00000001:01000000:0.0:1788305381.195647:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 521 MB/s 00000001:01000000:3.0:1788305381.449515:0:6496:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 551 MB/s 00010000:00010000:1.0:1788305381.469493:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788305381.469697:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:2.0:1788305381.491841:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788305381.492739:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788305381.492834:0:6496:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788305381.492873:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788305381.493104:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788305381.493134:0:6496:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788305381.496972:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305381.497187:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788305381.497194:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788305381.503080:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788305381.503095:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788305381.503902:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788305381.503910:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788305381.505215:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788305381.505239:0:6496:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.155@tcp' 00000020:01000004:2.0:1788305381.505241:0:6496:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788305381.505316:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.155@tcp (typ=mgc) 00000020:00000080:2.0:1788305381.505336:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.155@tcp (00000000aa71b48a) 00000020:00000080:2.0:1788305381.505364:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788305381.505453:0:6496:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f319ec22@MGC192.168.202.155@tcp: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305381.505828:0:6496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.155@tcp-0 is initialized 00000040:01000000:2.0:1788305381.505836:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788305381.506901:0:6515:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788305381.508052:0:6516:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788305381.508146:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.155@tcp (uuid 137eb269-2484-4047-a131-a502494b009f) 00000020:00000080:2.0:1788305381.508186:0:6496:0:(genops.c:1385:class_connect()) connect: client 137eb269-2484-4047-a131-a502494b009f, cookie 0x4a426866e6052fe1 00000100:00080000:2.0:1788305381.508200:0:6496:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305381.508214:0:6496:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import 00000000f319ec22 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305381.508258:0:6496:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ac3c77e x1875174015107200/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305381.508310:0:6496:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 137eb269-2484-4047-a131-a502494b009f->MGS 00000020:01000004:2.0:1788305381.508336:0:6496:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788305381.508342:0:6496:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788305381.508362:0:6496:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000007478805e) 00000020:00000080:2.0:1788305381.508377:0:6496:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788305381.511737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000ac3c77e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015107200:0@lo:250: 00000100:00100000:1.0:1788305381.511888:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305381.519865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107200 00000100:00100000:0.0:1788305381.519886:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107200 00000100:00100000:0.0:1788305381.519945:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305381.519954:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0e56a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875174015107200:12345-0@lo:250: 00010000:00080000:0.0:1788305381.519997:0:6512:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 137eb269-2484-4047-a131-a502494b009f@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1788305381.520036:0:6512:0:(genops.c:1385:class_connect()) connect: client 137eb269-2484-4047-a131-a502494b009f, cookie 0x4a426866e6052fef 00000100:00080000:0.0:1788305381.520225:0:6512:0:(import.c:65:import_set_state_nolock()) 000000001cbe6b4e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305381.520398:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0e56a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+5:3646:x1875174015107200:12345-0@lo:250: Request processed in 443us (8509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.520406:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305381.520493:0:3646:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788305381.520503:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788305381.520510:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788305381.520515:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788305381.520518:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000f319ec22 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788305381.520528:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788305381.520548:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788305381.520555:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000ac3c77e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015107200:0@lo:250: 00000100:00100000:0.0:1788305381.535781:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305381.536000:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788305381.536011:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788305381.541254:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305381.541271:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788305381.544926:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788305381.544949:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788305381.545760:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305381.545957:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788305381.545962:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788305381.550556:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788305381.550567:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788305381.630164:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305381.630406:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788305381.630412:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788305381.635825:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788305381.635840:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788305381.639973:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305381.640159:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305381.640165:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788305381.642061:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305381.642074:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788305381.642849:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305381.643030:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305381.643035:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788305381.644132:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305381.644141:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788305381.645668:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305381.645949:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305381.645956:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788305381.646780:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305381.646789:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788305381.673636:0:6496:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305381.674694:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305381.674704:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788305381.676625:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788305381.676638:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788305381.678103:0:6496:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305381.678116:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788305381.680225:0:6496:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788305381.680260:0:6496:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788305381.680266:0:6496:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788305381.680408:0:6496:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788305381.680457:0:6496:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788305381.680462:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788305381.680463:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.680465:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.680466:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305381.680467:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.680468:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.680470:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.680471:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.680472:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305381.680473:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305381.680475:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.680477:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305381.680479:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788305381.680481:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305381.680482:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.680483:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.680484:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305381.680485:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.680486:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.680487:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.680488:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.680489:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305381.680489:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305381.680490:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.680491:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788305381.680517:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788305381.680740:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107328:0@lo:253: 00000100:00100000:2.0:1788305381.680823:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305381.680976:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107328 00000100:00100000:0.0:1788305381.680984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107328 00000100:00100000:0.0:1788305381.681036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305381.681045:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de90f2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+5:6496:x1875174015107328:12345-0@lo:253: 20000000:01000000:0.0:1788305381.681091:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788305381.681094:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:2.0:1788305381.681482:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4d49a88 going to sleep for 11 seconds 10000000:01000000:3.0:1788305381.681785:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788305381.681848:0:6514:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788305381.682208:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305381.684689:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788305381.685044:0:6514:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788305381.685049:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788305381.685055:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788305381.685067:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788305381.685079:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788305381.685838:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305381.686059:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788305381.686073:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305381.686091:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788305381.686108:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788305381.686121:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788305381.686613:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788305381.686622:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788305381.686635:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788305381.686641:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788305381.686653:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788305381.686657:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788305381.686669:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788305381.686684:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788305381.686714:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788305381.686719:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788305381.686726:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305381.687084:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788305381.687096:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788305381.687111:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788305381.687125:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788305381.687139:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788305381.687147:0:6514:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788305381.688465:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788305381.688486:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788305381.688505:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788305381.688605:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788305381.688629:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788305381.688641:0:6514:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788305381.688682:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788305381.688704:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788305381.688719:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788305381.688732:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788305381.688923:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788305381.688947:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788305381.688955:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788305381.689587:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788305381.689776:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788305381.689861:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.155@tcp for mdt 20000000:01000000:3.0:1788305381.689863:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788305381.689877:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788305381.689882:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788305381.689892:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788305381.689896:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:3.0:1788305381.689905:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788305381.689911:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788305381.689921:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788305381.689932:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788305381.689957:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788305381.689961:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788305381.689964:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788305381.690034:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788305381.690037:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788305381.690614:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788305381.690763:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788305381.690993:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788305381.691015:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788305381.691024:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788305381.691025:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788305381.691739:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788305381.692015:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788305381.692034:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788305381.692045:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788305381.692055:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305381.692065:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788305381.692070:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788305381.692072:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788305381.692076:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788305381.692081:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788305381.692663:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788305381.692778:0:6514:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788305381.719137:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788305381.719185:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788305381.719199:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788305381.719218:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788305381.719238:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719253:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719262:0:6514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719498:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719504:0:6514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719511:0:6514:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719516:0:6514:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d3c684f5 already unused, calling callback (000000005c970c71) 00010000:00010000:0.0:1788305381.719581:0:6514:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719589:0:6514:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719600:0:6514:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719607:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.719613:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d3c684f5/0x4a426866e6052ff6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305381.719630:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788305381.729677:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de90f2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+5:6496:x1875174015107328:12345-0@lo:253: Request processed in 48625us (48846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.729692:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305381.729772:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107328:0@lo:253: 10000000:01000000:2.0:1788305381.729802:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788305381.729806:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305381.729807:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.729809:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.729810:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788305381.729811:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.729813:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.729814:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.729816:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.729817:0:6496:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788305381.729818:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.729820:0:6496:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305381.729840:0:6496:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d85a7a99 from lustre-MDT0000 10000000:01000000:2.0:1788305381.729871:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788305381.729874:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788305381.729879:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff889186788000 10000000:01000000:2.0:1788305381.729883:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305381.729890:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889186788000 from 1 10000000:01000000:2.0:1788305381.729893:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788305381.729998:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.730010:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.730019:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.730038:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107456:0@lo:101: 00000100:00100000:2.0:1788305381.730087:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.730242:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.730489:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107456 00000100:00100000:0.0:1788305381.730502:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107456 00000100:00100000:0.0:1788305381.730572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305381.730581:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb889a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+5:6496:x1875174015107456:12345-0@lo:101: 00010000:00010000:0.0:1788305381.730592:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305381.730606:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6052ffd expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.730627:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6052ffd expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.730637:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6052ffd expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.730647:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f55b4cc9, rc 0) 00000100:00100000:0.0:1788305381.730725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb889a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+6:6496:x1875174015107456:12345-0@lo:101: Request processed in 146us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.730731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305381.730803:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107456:0@lo:101: 00010000:00010000:2.0:1788305381.730824:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.730832:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.730886:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107584:0@lo:501: 00000100:00100000:2.0:1788305381.730912:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.730979:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.731065:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107584 00000100:00100000:0.0:1788305381.731070:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107584 00000100:00100000:0.0:1788305381.731102:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305381.731109:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039dc7b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+6:6496:x1875174015107584:12345-0@lo:501: 00000100:00100000:0.0:1788305381.731327:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039dc7b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+6:6496:x1875174015107584:12345-0@lo:501: Request processed in 219us (415us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305381.731334:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305381.731479:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107584:0@lo:501: 10000000:01000000:2.0:1788305381.731511:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788305381.731523:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731531:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305381.731539:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88918c9a3800 10000000:01000000:2.0:1788305381.731543:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305381.731546:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88918c9a3800 10000000:01000000:2.0:1788305381.731549:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788305381.731551:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88918c9a3800 from 1 10000000:01000000:2.0:1788305381.731553:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788305381.731570:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731576:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731596:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.731608:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107712:0@lo:101: 00000100:00100000:2.0:1788305381.731635:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.731660:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107712 00000100:00100000:2.0:1788305381.731665:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107712 00000100:00100000:2.0:1788305381.731685:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305381.731690:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000051e80af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+6:6496:x1875174015107712:12345-0@lo:101: 00010000:00010000:2.0:1788305381.731698:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305381.731710:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bbb067e4/0x4a426866e6053012 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605300b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731726:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bbb067e4/0x4a426866e6053012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605300b expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731734:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bbb067e4/0x4a426866e6053012 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605300b expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731740:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bbb067e4, rc 0) 00000100:00100000:2.0:1788305381.731764:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000051e80af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+7:6496:x1875174015107712:12345-0@lo:101: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.731770:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305381.731797:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.731810:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107712:0@lo:101: 00010000:00010000:2.0:1788305381.731818:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731836:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305381.731847:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788305381.731850:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731856:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000001925cf29/0x4a426866e605300b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305381.731861:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788305381.731865:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305381.731868:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88918c9a3800 10000000:01000000:2.0:1788305381.731870:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788305381.731873:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788305381.731874:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305381.731887:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731892:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.731899:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.731910:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107840:0@lo:101: 00000100:00100000:2.0:1788305381.732062:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.732116:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.732323:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107840 00000100:00100000:3.0:1788305381.732329:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107840 00000100:00100000:3.0:1788305381.732474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305381.732484:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e33c305d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+7:6496:x1875174015107840:12345-0@lo:101: 00010000:00010000:3.0:1788305381.732492:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305381.732501:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053019 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.732516:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053019 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.732523:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053019 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.732530:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089db04a9, rc 0) 00000100:00100000:3.0:1788305381.732598:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e33c305d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+8:6496:x1875174015107840:12345-0@lo:101: Request processed in 116us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.732604:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305381.732680:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107840:0@lo:101: 00010000:00010000:2.0:1788305381.732692:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.732699:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.732747:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107968:0@lo:501: 00000100:00100000:2.0:1788305381.732773:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.732800:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.732845:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015107968 00000100:00100000:3.0:1788305381.732850:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015107968 00000100:00100000:3.0:1788305381.732867:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305381.732872:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ded8da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+8:6496:x1875174015107968:12345-0@lo:501: 00000100:00100000:3.0:1788305381.733100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ded8da9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+9:6496:x1875174015107968:12345-0@lo:501: Request processed in 226us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.733107:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305381.733568:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015107968:0@lo:501: 00000100:00100000:2.0:1788305381.733616:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108096:0@lo:503: 00000100:00100000:2.0:1788305381.733658:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.733722:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3eb4703 going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.733760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108096 00000100:00100000:3.0:1788305381.733765:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108096 00000100:00100000:3.0:1788305381.733828:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305381.733836:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053a0269a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+9:6496:x1875174015108096:12345-0@lo:503: 00000100:00100000:3.0:1788305381.733923:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053a0269a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+9:6496:x1875174015108096:12345-0@lo:503: Request processed in 88us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.733938:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305381.734012:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108096:0@lo:503: 00000100:00100000:1.0:1788305381.734589:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d4d6caae pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6541:1875174015108224:0@lo:502: 00000100:00100000:1.0:1788305381.734634:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305381.734791:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017b85eed going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.734854:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108224 00000100:00100000:0.0:1788305381.734860:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108224 00000100:00100000:0.0:1788305381.734887:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305381.734894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000083b71097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+9:6541:x1875174015108224:12345-0@lo:502: 00000100:00100000:0.0:1788305381.735002:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000083b71097 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+9:6541:x1875174015108224:12345-0@lo:502: Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.735015:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305381.735144:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d4d6caae pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6541:1875174015108224:0@lo:502: 00000020:01000000:1.0:1788305381.735185:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305381.735197:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305381.735199:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788305381.735203:0:6541:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788305381.735205:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305381.735224:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005c31c261) 00000020:00000080:1.0:1788305381.735244:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788305381.735250:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788305381.735505:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788305381.735513:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e605302e 00000020:00000080:1.0:1788305381.735720:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788305381.735731:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305381.735735:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305381.735736:0:6541:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788305381.735739:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305381.735742:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305381.735743:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788305381.735747:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305381.735752:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000008e48fc69) 00000020:00000080:1.0:1788305381.735762:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788305381.735766:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788305381.735767:0:6541:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788305381.735770:0:6541:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788305381.735775:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788305381.735839:0:6541:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d85a7a99 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788305381.735852:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004443cb2a) 00000020:00000080:1.0:1788305381.735868:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788305381.735919:0:6541:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788305381.735924:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6053043 00000020:00000080:1.0:1788305381.736083:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788305381.736089:0:6541:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788305381.736093:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4a426866e605304a 00080000:01000000:1.0:1788305381.736098:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788305381.736101:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6053051 00080000:10000000:0.0:1788305381.737093:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788305381.737517:0:6541:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788305381.742579:0:6541:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788305381.806541:0:6541:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788305381.806864:0:6541:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788305381.810648:0:6541:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788305381.811017:0:6541:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788305381.814539:0:6541:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ce661c4d) 00000020:00000080:2.0:1788305381.814560:0:6541:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788305381.814645:0:6541:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788305381.814653:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e605305f 00000020:00000080:2.0:1788305381.821138:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788305381.822047:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.824841:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.827041:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788305381.831214:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788305381.833712:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788305381.835669:0:6541:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788305381.837646:0:6541:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4a426866e6053066 00000020:00000080:3.0:1788305381.838059:0:6541:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788305381.838070:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305381.838076:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305381.838078:0:6541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788305381.838081:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305381.838085:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305381.838086:0:6541:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305381.838088:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305381.838090:0:6541:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305381.838092:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305381.838094:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305381.838095:0:6541:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788305381.838097:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305381.838101:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305381.838102:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788305381.838106:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788305381.838153:0:6541:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788305381.838228:0:6541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009e9393ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6541:1875174015108352:0@lo:502: 00000100:00100000:3.0:1788305381.838349:0:6541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.838403:0:6541:0:(client.c:2715:ptlrpc_set_wait()) set 00000000664f544a going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.838521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108352 00000100:00100000:2.0:1788305381.838529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108352 00000100:00100000:2.0:1788305381.838581:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305381.838590:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000402566f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+9:6541:x1875174015108352:12345-0@lo:502: 00000100:00100000:2.0:1788305381.838740:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000402566f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+9:6541:x1875174015108352:12345-0@lo:502: Request processed in 149us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.838749:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305381.838879:0:6541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009e9393ba pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6541:1875174015108352:0@lo:502: 00000020:01000000:1.0:1788305381.838908:0:6541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305381.838914:0:6541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305381.838915:0:6541:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788305381.838920:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788305381.839138:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788305381.839160:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788305381.839185:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.839196:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305381.839203:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a3800 from 1 10000000:01000000:2.0:1788305381.839207:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305381.839233:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.839240:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.839249:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.839261:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108480:0@lo:101: 00000100:00100000:2.0:1788305381.839324:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.839346:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000448ceb69 going to sleep for 11 seconds 00000100:00100000:1.0:1788305381.839498:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108480 00000100:00100000:1.0:1788305381.839504:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108480 00000100:00100000:1.0:1788305381.839531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305381.839537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c112a55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+9:6496:x1875174015108480:12345-0@lo:101: 00010000:00010000:1.0:1788305381.839557:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305381.839571:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605306d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305381.839591:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605306d expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305381.839600:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605306d expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305381.839608:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a048078b, rc 0) 00000100:00100000:1.0:1788305381.839652:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c112a55e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+10:6496:x1875174015108480:12345-0@lo:101: Request processed in 115us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305381.839659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305381.839743:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000073010448 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108480:0@lo:101: 00010000:00010000:3.0:1788305381.839756:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.839765:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305381.840357:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b4c9c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108608:0@lo:256: 00000100:00100000:3.0:1788305381.840403:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.840436:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a662cc33 going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.840551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108608 00000100:00100000:2.0:1788305381.840557:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108608 00000100:00100000:2.0:1788305381.840592:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305381.840597:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5487a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+10:6496:x1875174015108608:12345-0@lo:256: 20000000:01000000:2.0:1788305381.840610:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788305381.840616:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788305381.840679:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5487a78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+10:6496:x1875174015108608:12345-0@lo:256: Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.840684:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305381.840751:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b4c9c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108608:0@lo:256: 10000000:01000000:3.0:1788305381.842033:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305381.842082:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.842091:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305381.842096:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a3800 from 1 10000000:01000000:3.0:1788305381.842098:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305381.842126:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.842131:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.842772:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305381.842793:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006b4c9c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108736:0@lo:101: 00000100:00100000:3.0:1788305381.842850:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.842876:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a662cc33 going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.843655:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108736 00000100:00100000:2.0:1788305381.843664:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108736 00000100:00100000:2.0:1788305381.843710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305381.843715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cebc89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+10:6496:x1875174015108736:12345-0@lo:101: 00010000:00010000:2.0:1788305381.843726:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305381.843739:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605307b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.843755:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605307b expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.843761:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605307b expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.843767:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae7740e3, rc 0) 00000100:00100000:2.0:1788305381.843814:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cebc89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015108736:12345-0@lo:101: Request processed in 98us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.843821:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305381.843902:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006b4c9c7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108736:0@lo:101: 00010000:00010000:0.0:1788305381.843913:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.843919:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305381.843993:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108864:0@lo:501: 00000100:00100000:0.0:1788305381.844016:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305381.844042:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087d9f88d going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.844120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108864 00000100:00100000:2.0:1788305381.844125:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108864 00000100:00100000:2.0:1788305381.844163:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305381.844179:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067ecc0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015108864:12345-0@lo:501: 00000100:00100000:2.0:1788305381.844330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067ecc0af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015108864:12345-0@lo:501: Request processed in 161us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.844335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305381.844434:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108864:0@lo:501: 00000100:00100000:0.0:1788305381.844459:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108992:0@lo:503: 00000100:00100000:0.0:1788305381.844491:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305381.844511:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087d9f88d going to sleep for 11 seconds 00000100:00100000:2.0:1788305381.844549:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015108992 00000100:00100000:2.0:1788305381.844553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015108992 00000100:00100000:2.0:1788305381.844582:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305381.844588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3180e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015108992:12345-0@lo:503: 00000040:00080000:2.0:1788305381.844613:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305381.844648:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3180e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015108992:12345-0@lo:503: Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305381.844654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305381.844713:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015108992:0@lo:503: 00000040:00080000:0.0:1788305381.845694:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788305381.845902:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788305381.845920:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305381.846126:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.846135:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305381.846188:0:6496:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788305381.846191:0:6496:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88918c9a3800 10000000:01000000:2.0:1788305381.846194:0:6496:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88918c9a3800 10000000:01000000:2.0:1788305381.846197:0:6496:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305381.846202:0:6496:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a3800 from 1 10000000:01000000:2.0:1788305381.846205:0:6496:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305381.846232:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.846250:0:6496:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.846258:0:6496:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.846272:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109120:0@lo:101: 00000100:00100000:2.0:1788305381.846341:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.846378:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d40053de going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.846454:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109120 00000100:00100000:3.0:1788305381.846460:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109120 00000100:00100000:3.0:1788305381.846495:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305381.846500:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009def0226 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:6496:x1875174015109120:12345-0@lo:101: 00010000:00010000:3.0:1788305381.846508:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305381.846518:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053089 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.846537:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.846545:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.846552:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013e6233f, rc 0) 00000100:00100000:3.0:1788305381.846594:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009def0226 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109120:12345-0@lo:101: Request processed in 93us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.846598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305381.846665:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109120:0@lo:101: 00010000:00010000:2.0:1788305381.846678:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.846684:0:6496:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.846722:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109248:0@lo:501: 00000100:00100000:2.0:1788305381.846739:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.846761:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d40053de going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.846804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109248 00000100:00100000:3.0:1788305381.846808:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109248 00000100:00100000:3.0:1788305381.846839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305381.846846:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b1b1cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109248:12345-0@lo:501: 00000100:00100000:3.0:1788305381.847061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b1b1cf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109248:12345-0@lo:501: Request processed in 215us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.847067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305381.847121:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109248:0@lo:501: 00000100:00100000:2.0:1788305381.847144:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109376:0@lo:503: 00000100:00100000:2.0:1788305381.847197:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.847219:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d40053de going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.847296:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109376 00000100:00100000:0.0:1788305381.847300:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109376 00000100:00100000:0.0:1788305381.847323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305381.847327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008de239a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109376:12345-0@lo:503: 00000100:00100000:0.0:1788305381.847402:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008de239a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109376:12345-0@lo:503: Request processed in 74us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.847415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305381.847514:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109376:0@lo:503: 00000100:00100000:3.0:1788305381.847817:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ef6dff9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6546:1875174015109504:0@lo:502: 00000100:00100000:3.0:1788305381.847852:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.847881:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4432c2b going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.847913:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109504 00000100:00100000:0.0:1788305381.847916:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109504 00000100:00100000:0.0:1788305381.848009:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305381.848014:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087ac4be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6546:x1875174015109504:12345-0@lo:502: 00000100:00100000:0.0:1788305381.848075:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087ac4be7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6546:x1875174015109504:12345-0@lo:502: Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.848079:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305381.848126:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ef6dff9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6546:1875174015109504:0@lo:502: 00000020:01000004:3.0:1788305381.848165:0:6546:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788305381.848189:0:6546:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000003a2a97c0) 00000020:00000080:3.0:1788305381.848208:0:6546:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788305381.848303:0:6546:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d85a7a99 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788305381.848306:0:6546:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d85a7a99 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788305381.848308:0:6546:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d85a7a99 4 00010000:00080000:3.0:1788305381.848327:0:6546:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3ba8bd4@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305381.849967:0:6546:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788305381.850164:0:6546:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788305381.850213:0:6546:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305381.850226:0:6546:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4a426866e605309e 00000100:00080000:3.0:1788305381.850235:0:6546:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305381.850239:0:6546:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d3ba8bd4 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305381.850265:0:6546:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003ef6dff9 x1875174015109632/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305381.851854:0:6546:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305381.852017:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6546:1875174015109760:0@lo:502: 00000100:00100000:3.0:1788305381.852082:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.852110:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109760 00000100:00100000:3.0:1788305381.852118:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109760 00000100:00100000:3.0:1788305381.852148:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305381.852153:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8065d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:6546:x1875174015109760:12345-0@lo:502: 00000100:00100000:3.0:1788305381.852262:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8065d97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:6546:x1875174015109760:12345-0@lo:502: Request processed in 108us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.852268:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305381.852324:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4131f4d going to sleep for 11 seconds 00000100:00100000:3.0:1788305381.852342:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:6546:1875174015109760:0@lo:502: 00000040:00080000:3.0:1788305381.852365:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788305381.852547:0:6496:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788305381.852574:0:6496:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305381.852593:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305381.852600:0:6496:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305381.852641:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788305381.852643:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.852644:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.852645:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305381.852646:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.852647:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.852648:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.852650:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.852651:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305381.852652:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305381.852654:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.852655:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305381.852659:0:6496:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788305381.852661:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305381.852662:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.852663:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.852664:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305381.852665:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.852666:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.852667:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.852668:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.852669:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305381.852669:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305381.852670:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.852671:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305381.852682:0:6496:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788305381.852688:0:6496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109888:0@lo:253: 00000100:00100000:2.0:1788305381.852712:0:6496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305381.852724:0:6496:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042d20c30 going to sleep for 11 seconds 00000100:00100000:0.0:1788305381.852786:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109888 00000100:00100000:0.0:1788305381.852791:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109888 00000100:00100000:0.0:1788305381.852826:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788305381.852833:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a0d0ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109888:12345-0@lo:253: 20000000:01000000:0.0:1788305381.852852:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788305381.852864:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788305381.854966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003ef6dff9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015109632:0@lo:38: 00000100:00100000:1.0:1788305381.855036:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.855403:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015109632 00000100:00100000:3.0:1788305381.855411:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015109632 00000100:00100000:3.0:1788305381.855451:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305381.855457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4d6caae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015109632:12345-0@lo:38: 00000100:00100000:3.0:1788305381.855514:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4d6caae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015109632:12345-0@lo:38: Request processed in 56us (477us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788305381.855519:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305381.855607:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305381.855615:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000d3ba8bd4 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305381.855620:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788305381.855623:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003ef6dff9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015109632:0@lo:38: 20000000:01000000:0.0:1788305381.858270:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305381.858515:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788305381.858769:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a0d0ea5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6496:x1875174015109888:12345-0@lo:253: Request processed in 5933us (6052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305381.858781:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305381.858902:0:6496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:6496:1875174015109888:0@lo:253: 10000000:01000000:2.0:1788305381.858937:0:6496:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788305381.858940:0:6496:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305381.858942:0:6496:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305381.858943:0:6496:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305381.858944:0:6496:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305381.858945:0:6496:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305381.858946:0:6496:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305381.858947:0:6496:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305381.858949:0:6496:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305381.858950:0:6496:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788305381.858951:0:6496:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788305381.858953:0:6496:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305381.858954:0:6496:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305381.858967:0:6496:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788305381.860918:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788305381.860948:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788305381.860972:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.860986:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605306d expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.860992:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.861027:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605306d expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.861052:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605306d expref: 11 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305381.861063:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015110016:0@lo:104: 00000100:00100000:3.0:1788305381.861111:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305381.861207:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d4131f4d going to sleep for 11 seconds 00000100:00100000:1.0:1788305381.863062:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110016 00000100:00100000:1.0:1788305381.863074:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110016 00000100:00100000:1.0:1788305381.863119:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305381.863125:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009544f960 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015110016:12345-0@lo:104: 00010000:00010000:1.0:1788305381.863138:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305381.863227:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305381.863233:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009544f960 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015110016:12345-0@lo:104: Request processed in 108us (2121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305381.863240:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788305381.863301:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305381.863306:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.863321:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087226f0d already unused, calling callback (000000001620736b) 10000000:00010000:0.0:1788305381.863323:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.863328:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305381.863332:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305381.863336:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305381.863374:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.863381:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305381.863396:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.863403:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 0000000087226f0d/0x4a426866e605306d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053074 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305381.863421:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305381.863423:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305381.863424:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305381.863470:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305381.863479:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015110144:0@lo:103: 00000100:00100000:0.0:1788305381.863507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1788305381.864178:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.864362:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788305381.864560:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.864702:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788305381.864892:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.865152:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:3.0:1788305381.865518:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110144 00000100:00100000:3.0:1788305381.865527:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110144 00010000:00010000:3.0:1788305381.865555:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605306d expref: 12 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305381.865592:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305381.865598:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099b85f64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+12:3647:x1875174015110144:12345-0@lo:103: 00010000:00010000:3.0:1788305381.865608:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305381.865613:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605306d expref: 12 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865624:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605306d expref: 12 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865642:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865650:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305381.865665:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004739607s 00010000:00010000:3.0:1788305381.865669:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865680:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865685:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865688:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865691:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009bd0729f already unused, calling callback (000000005c970c71) 00010000:00010000:3.0:1788305381.865694:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865698:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865703:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865711:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305381.865778:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099b85f64 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+12:3647:x1875174015110144:12345-0@lo:103: Request processed in 180us (2269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305381.865785:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788305381.865823:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a048078b/0x4a426866e6053074 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605306d expref: 11 pid: 6514 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305381.865832:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015110016:0@lo:104: 00010000:00010000:3.0:1788305381.865845:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865858:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865861:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305381.865865:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009bd0729f/0x4a426866e60530a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305381.865914:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a51689ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015110144:0@lo:103: 00080000:10000000:2.0:1788305381.866543:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.866696:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788305381.866843:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.867008:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788305381.867146:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788305381.867514:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788305381.869483:0:6496:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788305381.874899:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788305381.875141:0:6552:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788305381.876197:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788305381.876333:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788305381.876721:0:6496:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788305381.876727:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788305381.876814:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305381.877598:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788305381.878003:0:6496:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788305381.878023:0:6496:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:1.0:1788305381.879476:0:6551:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788305381.879488:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788305381.879890:0:6552:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305381.883892:0:6496:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305381.884620:0:6552:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788305381.884690:0:6552:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788305381.884694:0:6552:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:3.0:1788305381.884922:0:6496:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788305381.886019:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788305381.886212:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788305381.886664:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788305381.886801:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788305381.887033:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788305381.887259:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788305381.887533:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788305381.887670:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788305381.887808:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788305381.888048:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788305381.888234:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788305381.888515:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788305381.888651:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788305381.888789:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788305381.889037:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788305381.889196:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788305381.889522:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788305381.889686:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788305381.889841:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788305381.890048:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788305381.890225:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788305381.890627:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788305381.890765:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788305381.890916:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788305381.891133:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788305381.891386:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788305381.891518:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788305381.891635:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788305381.892047:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788305381.892181:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788305381.892484:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788305381.892618:0:6496:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788305381.892819:0:6496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788305381.899525:0:6496:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788305381.899564:0:6496:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff94a3c190f988 00100000:10000000:2.0:1788305381.899572:0:6496:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788305381.900108:0:6496:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788305381.900124:0:6496:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788305381.900142:0:6496:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788305381.900158:0:6496:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788305381.900873:0:6496:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305381.903197:0:6496:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788305382.491619:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305383.509482:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305384.534000:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305385.558019:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305386.581461:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305386.971250:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305386.971261:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788305386.971264:0:37:0:(import.c:65:import_set_state_nolock()) 00000000d3ba8bd4 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305386.971290:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d3ba8bd4 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305386.971327:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dd3f4f43 x1875174015110400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305386.971379:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015110400:0@lo:38: 00000100:00100000:2.0:1788305386.971496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305386.971668:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305386.971678:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015110272:0@lo:400: 00000100:00100000:1.0:1788305386.971714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305386.971815:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110400 00000100:00100000:1.0:1788305386.971823:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110400 00000100:00100000:1.0:1788305386.971871:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305386.971878:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008452c65d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015110400:12345-0@lo:38: 00010000:00080000:1.0:1788305386.971901:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1788305386.971950:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4a426866e60530ac 00000004:00100000:1.0:1788305386.972111:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305386.972249:0:6521:0:(import.c:65:import_set_state_nolock()) 000000008518e07b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305386.972322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008452c65d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875174015110400:12345-0@lo:38: Request processed in 443us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305386.972330:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305386.972407:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110272 00000100:00100000:2.0:1788305386.972411:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110272 00000100:00100000:2.0:1788305386.972446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305386.972452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e37237ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+11:3650:x1875174015110272:12345-0@lo:400: 00000100:00100000:2.0:1788305386.972493:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e37237ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+11:3650:x1875174015110272:12345-0@lo:400: Request processed in 41us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305386.972499:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305386.972534:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c40061bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015110272:0@lo:400: 00010000:00080000:2.0:1788305386.972558:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dd3f4f43 x1875174015110400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788305386.972572:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788305386.972577:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788305386.972581:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788305386.972583:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000d3ba8bd4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305386.972588:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015110400:0@lo:38: 00000001:02000400:3.0:1788305387.258776:0:6797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788305387.609699:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788305388.351785:0:6849:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305388.353846:0:6849:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788305388.630801:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788305389.526087:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305389.526096:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a3800 from 3 10000000:01000000:1.0:1788305389.526133:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305389.526188:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305389.526212:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305389.526667:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305389.526695:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027aef7d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015110528:0@lo:101: 00000100:00100000:1.0:1788305389.526763:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305389.526843:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000504651fb going to sleep for 11 seconds 00000100:00100000:0.0:1788305389.527076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110528 00000100:00100000:0.0:1788305389.527084:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110528 00000100:00100000:0.0:1788305389.527146:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305389.527155:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b797c9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+11:6516:x1875174015110528:12345-0@lo:101: 00010000:00010000:0.0:1788305389.527169:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305389.527185:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60530b3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305389.527217:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60530b3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305389.527237:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60530b3 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305389.527246:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086ed2092, rc 0) 00000100:00100000:0.0:1788305389.527315:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b797c9f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:6516:x1875174015110528:12345-0@lo:101: Request processed in 161us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305389.527322:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305389.527562:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027aef7d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015110528:0@lo:101: 00010000:00010000:1.0:1788305389.527577:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305389.527585:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305389.527640:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027aef7d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015110656:0@lo:256: 00000100:00100000:1.0:1788305389.527674:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305389.527746:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000504651fb going to sleep for 11 seconds 00000100:00100000:2.0:1788305389.533108:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110656 00000100:00100000:2.0:1788305389.533124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110656 00000100:00100000:2.0:1788305389.533215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305389.533234:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029f27501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:6516:x1875174015110656:12345-0@lo:256: 20000000:01000000:2.0:1788305389.533268:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305389.533337:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305389.533341:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788305389.533465:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029f27501 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:6516:x1875174015110656:12345-0@lo:256: Request processed in 242us (5791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305389.533473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305389.534336:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027aef7d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015110656:0@lo:256: 10000000:01000000:1.0:1788305389.534389:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305389.534397:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305389.534408:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305389.653512:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305390.679660:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305391.295990:0:6951:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305391.296182:0:6951:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305391.706212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305392.086604:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e2a3f013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015110912:0@lo:400: 00000100:00100000:3.0:1788305392.086685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305392.087422:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305392.087495:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015110784:0@lo:400: 00000100:00100000:1.0:1788305392.087542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305392.087606:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110912 00000100:00100000:1.0:1788305392.087614:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110912 00000100:00100000:1.0:1788305392.087658:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305392.087667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000605aa4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015110912:12345-0@lo:400: 00000100:00100000:1.0:1788305392.087723:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000605aa4ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015110912:12345-0@lo:400: Request processed in 58us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305392.087732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015110784 00000100:00100000:3.0:1788305392.087738:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015110784 00000100:00100000:1.0:1788305392.087752:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305392.087790:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305392.087799:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5c1f846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+12:3649:x1875174015110784:12345-0@lo:400: 00010000:00080000:1.0:1788305392.087804:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e2a3f013 x1875174015110912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305392.087821:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e2a3f013 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015110912:0@lo:400: 00000100:00100000:3.0:1788305392.087964:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5c1f846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+12:3649:x1875174015110784:12345-0@lo:400: Request processed in 167us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305392.087971:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305392.089674:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2885bb2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015110784:0@lo:400: 00010000:00010000:1.0:1788305392.735489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305393.756140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305394.774766:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305395.799643:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305396.823500:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305397.205624:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305397.205652:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000875b6a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015111040:0@lo:400: 00000100:00100000:3.0:1788305397.205732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305397.205961:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111040 00000100:00100000:0.0:1788305397.205970:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111040 00000100:00100000:0.0:1788305397.206064:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305397.206072:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d03832f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:3647:x1875174015111040:12345-0@lo:400: 00000100:00100000:0.0:1788305397.206130:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d03832f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:3647:x1875174015111040:12345-0@lo:400: Request processed in 60us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305397.206138:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305397.206339:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015111168:0@lo:400: 00000100:00100000:1.0:1788305397.206374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305397.207207:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111168 00000100:00100000:0.0:1788305397.207216:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111168 00000100:00100000:0.0:1788305397.207261:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305397.207269:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027aef7d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015111168:12345-0@lo:400: 00000100:00100000:0.0:1788305397.207352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027aef7d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015111168:12345-0@lo:400: Request processed in 84us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305397.207358:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305397.207754:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000875b6a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015111040:0@lo:400: 00010000:00080000:0.0:1788305397.209396:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000f837fad x1875174015111168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305397.209415:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015111168:0@lo:400: 00010000:00010000:2.0:1788305397.847375:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305398.869578:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305399.899478:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305400.917590:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305401.947741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788305402.080613:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305402.080617:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788305402.080619:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788305402.081022:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000062330eeb 00000020:01000004:3.0:1788305402.081045:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788305402.081059:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788305402.081073:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000b0c3941d) 00000020:00000080:3.0:1788305402.081090:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788305402.131473:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788305402.131549:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788305402.164157:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305402.164421:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788305402.164430:0:7449:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305402.164441:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e60530c8 00000020:01000004:0.0:1788305402.164447:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788305402.164467:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305402.164470:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305402.164476:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788305402.164501:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788305402.164505:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788305402.207065:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305402.207111:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788305402.207116:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305402.207118:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.207119:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.207120:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305402.207121:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.207123:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.207128:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.207129:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305402.207131:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305402.207132:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.207133:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305402.207137:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788305402.207139:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305402.207141:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.207142:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.207143:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305402.207144:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.207145:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.207145:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.207146:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305402.207147:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305402.207148:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.207149:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305402.207184:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788305402.207204:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015111296:0@lo:253: 00000100:00100000:0.0:1788305402.207395:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.207446:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ec8acf9 going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.207539:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111296 00000100:00100000:3.0:1788305402.207548:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111296 00000100:00100000:3.0:1788305402.207603:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305402.207611:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066f6af3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015111296:12345-0@lo:253: 20000000:01000000:3.0:1788305402.207638:0:6512:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788305402.207649:0:6512:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788305402.207654:0:6512:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788305402.207657:0:6512:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788305402.207691:0:6512:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788305402.207874:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305402.208038:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788305402.208051:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305402.208068:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788305402.208084:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788305402.208097:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788305402.208146:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788305402.208153:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788305402.208163:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788305402.208167:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788305402.208177:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788305402.208181:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788305402.208190:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788305402.208204:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788305402.208313:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788305402.208323:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788305402.208340:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788305402.208347:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305402.208359:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788305402.208365:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:3.0:1788305402.208376:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788305402.208382:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788305402.208393:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788305402.208409:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788305402.208418:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788305402.208484:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788305402.208492:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788305402.208510:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788305402.208524:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788305402.208537:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788305402.208542:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788305402.208552:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788305402.208568:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788305402.208572:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788305402.208591:0:6512:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788305402.208597:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788305402.210670:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788305402.210960:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788305402.211000:0:6512:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.155@tcp for mdt 20000000:01000000:0.0:1788305402.211002:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788305402.211019:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788305402.211025:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788305402.211036:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788305402.211041:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:0.0:1788305402.211055:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788305402.211061:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788305402.211076:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788305402.211091:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788305402.211145:0:6512:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788305402.211153:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788305402.211687:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788305402.211918:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788305402.211947:0:6512:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.155@tcp for mdt 20000000:01000000:0.0:1788305402.211949:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:0.0:1788305402.211963:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788305402.211970:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788305402.211995:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788305402.212001:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:0.0:1788305402.212015:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788305402.212022:0:6512:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788305402.212034:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788305402.212048:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788305402.212067:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788305402.212070:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788305402.212073:0:6512:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788305402.212134:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788305402.212136:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305402.212607:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305402.212631:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305402.212646:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788305402.212868:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788305402.212889:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788305402.212907:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788305402.212917:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788305402.212919:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305402.213173:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305402.213190:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305402.213204:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788305402.213588:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788305402.213609:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788305402.213623:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788305402.213634:0:6512:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788305402.213635:0:6512:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788305402.223067:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788305402.223125:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788305402.223143:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788305402.223806:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788305402.223837:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788305402.223852:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788305402.223869:0:6512:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788305402.223872:0:6512:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788305402.223876:0:6512:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788305402.223882:0:6512:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788305402.224449:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1788305402.224604:0:6512:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788305402.234053:0:6512:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788305402.234156:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234195:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6052ffd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234202:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053019 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234208:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234214:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234255:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.234268:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.234676:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111424:0@lo:104: 00000100:00100000:0.0:1788305402.234888:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305402.235020:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.235029:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 12 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.235037:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111552:0@lo:104: 00000100:00100000:0.0:1788305402.235062:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305402.235215:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.235231:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 12 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.235239:0:6512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111680:0@lo:104: 00000100:00100000:0.0:1788305402.235261:0:6512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.235307:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111424 00000100:00100000:3.0:1788305402.235315:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111424 00000100:00100000:2.0:1788305402.235422:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111552 00000100:00100000:2.0:1788305402.235427:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111552 00000100:00100000:2.0:1788305402.235451:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305402.235459:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034fbe62a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6512:x1875174015111424:12345-0@lo:104: 00010000:00010000:2.0:1788305402.235470:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235533:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305402.235538:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034fbe62a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6512:x1875174015111424:12345-0@lo:104: Request processed in 81us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.235545:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305402.235562:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305402.235567:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045948a2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6512:x1875174015111552:12345-0@lo:104: 00010000:00010000:2.0:1788305402.235574:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235607:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305402.235612:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045948a2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6512:x1875174015111552:12345-0@lo:104: Request processed in 45us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.235617:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788305402.235636:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305402.235646:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235653:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000056cc194c already unused, calling callback (000000001620736b) 10000000:00010000:2.0:1788305402.235656:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235663:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305402.235669:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.235673:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305402.235717:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235724:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305402.235841:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305402.235882:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235890:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e6053089 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053090 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.235901:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.235903:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.235905:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305402.235924:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015111808:0@lo:103: 00000100:00100000:2.0:1788305402.235954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305402.236223:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.236228:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.236242:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d51ee9a already unused, calling callback (000000001620736b) 10000000:00010000:2.0:1788305402.236244:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.236250:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305402.236256:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.236261:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305402.236303:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.236309:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305402.236324:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.236330:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e6053019 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053020 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.236340:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.236341:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.236343:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305402.236353:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305402.236361:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015111936:0@lo:103: 00000100:00100000:2.0:1788305402.236388:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305402.236417:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.236419:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305402.236481:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111808 00000100:00100000:1.0:1788305402.236486:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111808 00010000:00010000:1.0:1788305402.236506:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 13 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305402.236533:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111936 00000100:00100000:1.0:1788305402.236537:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111936 00010000:00010000:1.0:1788305402.236547:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305402.236559:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305402.236565:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c40061bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+14:3650:x1875174015111808:12345-0@lo:103: 00010000:00010000:1.0:1788305402.236574:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305402.236578:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.236594:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 14 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.236610:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305402.236637:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c40061bf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+14:3650:x1875174015111808:12345-0@lo:103: Request processed in 73us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.236643:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305402.236658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305402.236663:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007587fba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+13:3648:x1875174015111936:12345-0@lo:103: 00010000:00010000:1.0:1788305402.236670:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305402.236676:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 13 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.236683:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 13 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.236691:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305402.236712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007587fba8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+13:3648:x1875174015111936:12345-0@lo:103: Request processed in 50us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.236717:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305402.236939:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015111808:0@lo:103: 00000100:00100000:2.0:1788305402.236968:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015111936:0@lo:103: 00000100:00100000:0.0:1788305402.237080:0:6512:0:(client.c:2715:ptlrpc_set_wait()) set 000000002216f2f1 going to sleep for 11 seconds 00010000:00010000:0.0:1788305402.237095:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000013e6233f/0x4a426866e6053090 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053089 expref: 12 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.237105:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111424:0@lo:104: 00010000:00010000:0.0:1788305402.237113:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000089db04a9/0x4a426866e6053020 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053019 expref: 11 pid: 6512 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.237121:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111552:0@lo:104: 00000100:00100000:2.0:1788305402.237186:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015111680 00000100:00100000:2.0:1788305402.237190:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015111680 00000100:00100000:2.0:1788305402.237212:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305402.237218:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f80e40b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6512:x1875174015111680:12345-0@lo:104: 00010000:00010000:2.0:1788305402.237227:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.237341:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305402.237346:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f80e40b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6512:x1875174015111680:12345-0@lo:104: Request processed in 129us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.237351:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788305402.237495:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305402.237500:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.237508:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000124b1d7 already unused, calling callback (000000001620736b) 10000000:00010000:1.0:1788305402.237511:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.237532:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305402.237538:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305402.237543:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305402.237574:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.237580:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305402.237600:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.237606:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6052ffd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053004 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.237621:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305402.237622:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305402.237624:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305402.237658:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305402.237670:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b93ce8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015112064:0@lo:103: 00000100:00100000:3.0:1788305402.237718:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.237946:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112064 00000100:00100000:1.0:1788305402.237950:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112064 00010000:00010000:1.0:1788305402.237967:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 11 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305402.238000:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305402.238007:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a4cb659 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+11:3647:x1875174015112064:12345-0@lo:103: 00010000:00010000:1.0:1788305402.238014:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305402.238018:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 11 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238033:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 11 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238048:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238054:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238066:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238072:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238078:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238083:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238088:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e1bda5f already unused, calling callback (000000005c970c71) 00010000:00010000:1.0:1788305402.238091:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238096:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238102:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.238121:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305402.238156:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a4cb659 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+11:3647:x1875174015112064:12345-0@lo:103: Request processed in 151us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.238163:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305402.238244:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b93ce8c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015112064:0@lo:103: 00010000:00010000:0.0:1788305402.238678:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053004 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6052ffd expref: 10 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.238809:0:6512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6512:1875174015111680:0@lo:104: 00010000:00010000:0.0:1788305402.238830:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.238838:0:6512:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.238843:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.238848:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e1bda5f/0x4a426866e60530cf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305402.238872:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788305402.263104:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066f6af3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+9:7449:x1875174015111296:12345-0@lo:253: Request processed in 55483us (55700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.263130:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305402.263362:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015111296:0@lo:253: 10000000:01000000:0.0:1788305402.263378:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788305402.263382:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305402.263383:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.263385:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.263386:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788305402.263387:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.263388:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.263390:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.263391:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788305402.263393:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.263394:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305402.263415:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000062330eeb from lustre-MDT0001 10000000:01000000:0.0:1788305402.263449:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788305402.263452:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788305402.263458:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889186788000 local copy 10000000:01000000:0.0:1788305402.263462:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305402.263494:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.263505:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.263514:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.263532:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112192:0@lo:101: 00000100:00100000:0.0:1788305402.263569:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.263672:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000008650655d going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.267872:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112192 00000100:00100000:3.0:1788305402.267888:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112192 00000100:00100000:3.0:1788305402.268018:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305402.268047:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000602e2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+9:7449:x1875174015112192:12345-0@lo:101: 00010000:00010000:3.0:1788305402.268065:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305402.268084:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043668e6c/0x4a426866e60530dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60530d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.268141:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043668e6c/0x4a426866e60530dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60530d6 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.268152:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043668e6c/0x4a426866e60530dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60530d6 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.268161:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043668e6c, rc 0) 00000100:00100000:3.0:1788305402.268248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000602e2ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+10:7449:x1875174015112192:12345-0@lo:101: Request processed in 204us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.268256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305402.268384:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112192:0@lo:101: 00010000:00010000:2.0:1788305402.268403:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.268412:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.268521:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112320:0@lo:501: 00000100:00100000:2.0:1788305402.268556:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.271017:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c451649 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.272073:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112320 00000100:00100000:0.0:1788305402.272105:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112320 00000100:00100000:3.0:1788305402.272427:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305402.272438:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044274360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+10:7449:x1875174015112320:12345-0@lo:501: 00000100:00100000:3.0:1788305402.272572:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044274360 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+10:7449:x1875174015112320:12345-0@lo:501: Request processed in 136us (4016us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305402.272579:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305402.272663:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112320:0@lo:501: 10000000:01000000:2.0:1788305402.272684:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305402.272715:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305402.272726:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.272735:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.272751:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.272769:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788305402.272797:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8891894cd800 10000000:01000000:2.0:1788305402.272802:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305402.272807:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff889186788000 10000000:01000000:2.0:1788305402.272810:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788305402.272813:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff889186788000 from 1 10000000:01000000:2.0:1788305402.272816:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788305402.272845:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.272852:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.272860:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.272875:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112448:0@lo:101: 00000100:00100000:2.0:1788305402.272903:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.273350:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba63686e going to sleep for 11 seconds 00010000:00010000:2.0:1788305402.273367:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305402.273372:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.273384:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001e1bda5f already unused, calling callback (000000001620736b) 10000000:00010000:2.0:1788305402.273387:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.273394:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305402.273399:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.273403:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305402.273419:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.273424:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305402.273437:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.273442:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 000000001e1bda5f/0x4a426866e60530d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e60530dd expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.273454:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.273456:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305402.273457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305402.273465:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015112576:0@lo:103: 00000100:00100000:2.0:1788305402.273489:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.273572:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112448 00000100:00100000:1.0:1788305402.273578:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112448 00000100:00100000:1.0:1788305402.273602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305402.273609:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043367bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+10:7449:x1875174015112448:12345-0@lo:101: 00010000:00010000:1.0:1788305402.273616:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305402.273627:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008e6c4c8b/0x4a426866e60530eb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60530e4 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.273645:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008e6c4c8b/0x4a426866e60530eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60530e4 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.273654:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008e6c4c8b/0x4a426866e60530eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60530e4 expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.273661:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008e6c4c8b, rc 0) 00000100:00100000:1.0:1788305402.273706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043367bfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:7449:x1875174015112448:12345-0@lo:101: Request processed in 98us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.273712:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305402.273994:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112448:0@lo:101: 00010000:00010000:2.0:1788305402.274006:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274019:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.274044:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788305402.274059:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274065:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000005d51ee9a/0x4a426866e60530e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.274074:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8891894cd800 10000000:01000000:2.0:1788305402.274078:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788305402.274081:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8891894cd800 from 1 10000000:01000000:2.0:1788305402.274083:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788305402.274095:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274100:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274105:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.274115:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112704:0@lo:101: 00000100:00100000:2.0:1788305402.274148:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.274169:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba63686e going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.274182:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112704 00000100:00100000:2.0:1788305402.274185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112704 00000100:00100000:2.0:1788305402.274208:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305402.274212:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049230699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+11:7449:x1875174015112704:12345-0@lo:101: 00010000:00010000:2.0:1788305402.274218:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305402.274224:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087226f0d/0x4a426866e60530f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60530f2 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274234:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087226f0d/0x4a426866e60530f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60530f2 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274240:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087226f0d/0x4a426866e60530f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60530f2 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274246:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087226f0d, rc 0) 00000100:00100000:2.0:1788305402.274269:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049230699 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015112704:12345-0@lo:101: Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.274300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305402.274322:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112704:0@lo:101: 00010000:00010000:2.0:1788305402.274330:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274335:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.274343:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788305402.274345:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274350:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000056cc194c/0x4a426866e60530f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.274364:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788305402.274367:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305402.274370:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8891894cd800 10000000:01000000:2.0:1788305402.274372:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788305402.274375:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788305402.274376:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788305402.274389:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274394:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274399:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.274407:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112832:0@lo:101: 00000100:00100000:2.0:1788305402.274428:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.274435:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba63686e going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.274458:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112832 00000100:00100000:2.0:1788305402.274461:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112832 00000100:00100000:2.0:1788305402.274474:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305402.274478:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d18885e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015112832:12345-0@lo:101: 00010000:00010000:2.0:1788305402.274484:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305402.274489:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052b2f73a/0x4a426866e6053107 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053100 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274499:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052b2f73a/0x4a426866e6053107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053100 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274514:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052b2f73a/0x4a426866e6053107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053100 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274520:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052b2f73a, rc 0) 00000100:00100000:2.0:1788305402.274542:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d18885e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015112832:12345-0@lo:101: Request processed in 64us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.274547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305402.274566:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112832:0@lo:101: 00010000:00010000:2.0:1788305402.274573:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.274579:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.274643:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112960:0@lo:501: 00000100:00100000:2.0:1788305402.274663:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.274670:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba63686e going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.274684:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112960 00000100:00100000:2.0:1788305402.274687:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112960 00000100:00100000:2.0:1788305402.274705:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305402.274709:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d54153c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015112960:12345-0@lo:501: 00000100:00100000:2.0:1788305402.275643:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d54153c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015112960:12345-0@lo:501: Request processed in 929us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.275652:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305402.275741:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015112576 00000100:00100000:0.0:1788305402.275756:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015112576 00000100:00100000:0.0:1788305402.275803:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305402.275810:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048a669af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+13:3649:x1875174015112576:12345-0@lo:103: 00010000:00010000:0.0:1788305402.275820:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305402.275833:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000043668e6c/0x4a426866e60530dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60530d6 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.275846:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305402.275881:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048a669af pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+12:3649:x1875174015112576:12345-0@lo:103: Request processed in 72us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.275887:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305402.275917:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd3f4f43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015112576:0@lo:103: 00000100:00100000:1.0:1788305402.276602:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a1391ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015112960:0@lo:501: 00000100:00100000:1.0:1788305402.276666:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113088:0@lo:503: 00000100:00100000:1.0:1788305402.276715:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.277885:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eec1d889 going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.283109:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113088 00000100:00100000:2.0:1788305402.283124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113088 00000100:00100000:2.0:1788305402.283325:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305402.283333:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ec817eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113088:12345-0@lo:503: 00000100:00100000:2.0:1788305402.283506:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ec817eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113088:12345-0@lo:503: Request processed in 173us (6791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.283514:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305402.283614:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113088:0@lo:503: 00000040:00080000:1.0:1788305402.283896:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305402.283976:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113216:0@lo:502: 00000100:00100000:1.0:1788305402.284034:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.284228:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eec1d889 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.284404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113216 00000100:00100000:0.0:1788305402.284409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113216 00000100:00100000:0.0:1788305402.284438:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305402.284445:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9aebc88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113216:12345-0@lo:502: 00000100:00100000:0.0:1788305402.284533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9aebc88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113216:12345-0@lo:502: Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.284540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788305402.284625:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113216:0@lo:502: 00000040:00080000:1.0:1788305402.284847:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788305402.284875:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788305402.284889:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788305402.284903:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788305402.284918:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788305402.284931:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788305402.284942:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788305402.284953:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788305402.284966:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788305402.284989:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788305402.285008:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788305402.285025:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788305402.285040:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788305402.285055:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788305402.285070:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788305402.285084:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788305402.285097:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788305402.285111:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788305402.285124:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788305402.285139:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788305402.285153:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788305402.285166:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788305402.285190:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788305402.285214:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113344:0@lo:502: 00000100:00100000:1.0:1788305402.285254:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.285308:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eec1d889 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.285461:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113344 00000100:00100000:0.0:1788305402.285466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113344 00000100:00100000:0.0:1788305402.285490:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305402.285495:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c2e7d95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113344:12345-0@lo:502: 00000100:00100000:0.0:1788305402.285575:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c2e7d95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113344:12345-0@lo:502: Request processed in 80us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.285581:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788305402.285735:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113344:0@lo:502: 00000040:00080000:1.0:1788305402.285832:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788305402.285840:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1788305402.286375:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305402.286385:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305402.286388:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788305402.286394:0:7462:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1788305402.286397:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305402.286410:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000a874ceb7) 00000020:00000080:1.0:1788305402.286428:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1788305402.286434:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788305402.286512:0:7462:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788305402.286526:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6053115 00000020:00000080:1.0:1788305402.286727:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788305402.286732:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305402.286736:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305402.286737:0:7462:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1788305402.286740:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305402.286868:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305402.286871:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1788305402.286876:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305402.286891:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (000000003318e331) 00000020:00000080:1.0:1788305402.286902:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1788305402.286907:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788305402.286909:0:7462:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1788305402.286912:0:7462:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1788305402.286917:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788305402.286975:0:7462:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000062330eeb from lustre-MDT0001, refs=2 00000020:00000080:1.0:1788305402.287000:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000026b7ccb2) 00000020:00000080:1.0:1788305402.287009:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1788305402.287065:0:7462:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788305402.287071:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605312a 00000020:00000080:1.0:1788305402.288487:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1788305402.288831:0:7462:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788305402.288842:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4a426866e6053131 00080000:01000000:1.0:1788305402.288851:0:7462:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788305402.288855:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6053138 00080000:10000000:1.0:1788305402.289565:0:7462:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788305402.289706:0:7462:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00000100:00100000:2.0:1788305402.326196:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015113472:0@lo:400: 00000100:00100000:2.0:1788305402.326319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.331027:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113472 00000100:00100000:3.0:1788305402.331046:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113472 00000100:00100000:3.0:1788305402.331125:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305402.331135:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000393a94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015113472:12345-0@lo:400: 00000100:00100000:3.0:1788305402.331240:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000393a94ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015113472:12345-0@lo:400: Request processed in 107us (4922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.331248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788305402.331316:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b380034c x1875174015113472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305402.331330:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b380034c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015113472:0@lo:400: 00010000:00010000:2.0:1788305402.393762:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788305402.394120:0:7462:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788305402.397587:0:7462:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788305402.397936:0:7462:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788305402.408676:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788305402.408693:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305402.408700:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.408702:0:7462:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788305402.408705:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305402.408712:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.408713:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788305402.408716:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788305402.408722:0:7462:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:2.0:1788305402.408750:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305402.408765:0:7462:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000b5dbac0a) 00000020:00000080:2.0:1788305402.408787:0:7462:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788305402.408792:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788305402.408960:0:7462:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788305402.408967:0:7462:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788305402.408973:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6053146 00010000:00080000:2.0:1788305402.409017:0:7462:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000046f89fac@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305402.416394:0:7462:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788305402.417680:0:7462:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788305402.417698:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788305402.417735:0:7462:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788305402.417757:0:7462:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605314d 00000100:00080000:2.0:1788305402.417767:0:7462:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305402.417772:0:7462:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 0000000046f89fac using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305402.417807:0:7462:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e72692bf x1875174015113600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305402.417837:0:7462:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305402.418023:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e72692bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015113600:0@lo:38: 00000020:01000000:2.0:1788305402.418029:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305402.418033:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418034:0:7462:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788305402.418037:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788305402.418039:0:7462:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788305402.418041:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788305402.418042:0:7462:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788305402.418043:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788305402.418045:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418046:0:7462:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788305402.418048:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305402.418052:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418054:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788305402.418057:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788305402.418082:0:7462:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788305402.418092:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305402.418095:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418096:0:7462:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788305402.418098:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305402.418100:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418101:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788305402.418103:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788305402.418105:0:7462:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788305402.418151:0:7462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:3.0:1788305402.418153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788305402.418154:0:7462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305402.418155:0:7462:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788305402.418158:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:2.0:1788305402.418217:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:3.0:1788305402.418221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113600 00000100:00100000:3.0:1788305402.418227:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113600 10000000:01000000:2.0:1788305402.418247:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:3.0:1788305402.418256:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788305402.418261:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305402.418263:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d2ffd06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015113600:12345-0@lo:38: 00010000:00010000:2.0:1788305402.418271:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000000124b1d7/0x4a426866e6053100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.418301:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891894cd800 from 1 10000000:01000000:2.0:1788305402.418303:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00080000:3.0:1788305402.418305:0:6524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00010000:00010000:2.0:1788305402.418325:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.418332:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788305402.418335:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6053154 00010000:00010000:2.0:1788305402.418340:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00100000:3.0:1788305402.418348:0:6524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1788305402.418352:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c8204e96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113728:0@lo:101: 00000001:00000004:3.0:1788305402.418354:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788305402.418383:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.418404:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a47fc965 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.418745:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113728 00000100:00100000:0.0:1788305402.418750:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113728 00000100:00100000:0.0:1788305402.418805:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305402.418813:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa56cf9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+12:7449:x1875174015113728:12345-0@lo:101: 00010000:00010000:0.0:1788305402.418824:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305402.418836:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605315b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.418868:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605315b expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.418878:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605315b expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.418886:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f55b4cc9, rc 0) 00000100:00100000:0.0:1788305402.418929:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa56cf9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015113728:12345-0@lo:101: Request processed in 118us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.418936:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305402.418999:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c8204e96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113728:0@lo:101: 00010000:00010000:0.0:1788305402.419014:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.419023:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.420576:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113856:0@lo:256: 00000100:00100000:0.0:1788305402.420641:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.420822:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ff0679bb going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.424076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113856 00000100:00100000:3.0:1788305402.424090:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113856 00000100:00100000:3.0:1788305402.424746:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305402.424758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9518899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015113856:12345-0@lo:256: 20000000:01000000:3.0:1788305402.424787:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788305402.424804:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788305402.424808:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788305402.424950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9518899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015113856:12345-0@lo:256: Request processed in 195us (4309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.424959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788305402.425114:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113856:0@lo:256: 10000000:01000000:2.0:1788305402.425863:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305402.425885:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.425912:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305402.425921:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cd800 from 1 10000000:01000000:2.0:1788305402.425924:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305402.425956:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.425964:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.425973:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.426636:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113984:0@lo:101: 00000100:00100000:2.0:1788305402.426697:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.426737:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b477d30e going to sleep for 11 seconds 00000100:00100000:1.0:1788305402.426826:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015113984 00000100:00100000:1.0:1788305402.426833:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015113984 00000100:00100000:1.0:1788305402.426960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305402.426970:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004677ca3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015113984:12345-0@lo:101: 00010000:00010000:1.0:1788305402.426993:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305402.427008:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053169 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.427033:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053169 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.427042:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053169 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305402.427050:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e09a2e52, rc 0) 00000100:00100000:1.0:1788305402.427098:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004677ca3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015113984:12345-0@lo:101: Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.427105:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788305402.427519:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015113984:0@lo:101: 00010000:00010000:2.0:1788305402.427534:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305402.427544:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305402.427645:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114112:0@lo:501: 00000100:00100000:2.0:1788305402.427675:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.427699:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b477d30e going to sleep for 11 seconds 00000100:00100000:1.0:1788305402.428082:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114112 00000100:00100000:1.0:1788305402.428092:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114112 00000100:00100000:1.0:1788305402.428128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305402.428134:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073ee86b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015114112:12345-0@lo:501: 00000100:00100000:1.0:1788305402.428611:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073ee86b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015114112:12345-0@lo:501: Request processed in 477us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.428620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788305402.428692:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114112:0@lo:501: 00000100:00100000:2.0:1788305402.428728:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114240:0@lo:503: 00000100:00100000:2.0:1788305402.428772:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.428847:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b477d30e going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.429096:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114240 00000100:00100000:3.0:1788305402.429102:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114240 00000100:00100000:3.0:1788305402.429153:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305402.429160:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077e63392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015114240:12345-0@lo:503: 00000040:00080000:3.0:1788305402.429204:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305402.429271:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077e63392 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015114240:12345-0@lo:503: Request processed in 112us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.429295:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305402.429508:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114240:0@lo:503: 00000040:00080000:2.0:1788305402.429791:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305402.429852:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788305402.429932:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788305402.431407:0:6524:0:(import.c:65:import_set_state_nolock()) 0000000068bd532e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305402.431492:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d2ffd06 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015113600:12345-0@lo:38: Request processed in 13226us (13337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.431505:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305402.431711:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305402.431722:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788305402.431730:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788305402.431735:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305402.431737:0:3646:0:(import.c:65:import_set_state_nolock()) 0000000046f89fac lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305402.431757:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e72692bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015113600:0@lo:38: 00000100:00100000:3.0:1788305402.431969:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015114368:0@lo:41: 00000100:00100000:3.0:1788305402.432016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.432109:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114368 00000100:00100000:2.0:1788305402.432116:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114368 00000100:00100000:3.0:1788305402.432208:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305402.432216:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016a36401 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015114368:12345-0@lo:41: 00000004:00000024:3.0:1788305402.432241:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788305402.432303:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016a36401 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015114368:12345-0@lo:41: Request processed in 88us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.432310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305402.432339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000033412401 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015114368:0@lo:41: 00000040:00080000:1.0:1788305402.433120:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788305402.433555:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788305402.433584:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305402.433602:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.433613:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305402.433682:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788305402.433686:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8891894cd800 10000000:01000000:3.0:1788305402.433689:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8891894cd800 10000000:01000000:3.0:1788305402.433693:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305402.433707:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891894cd800 from 1 10000000:01000000:3.0:1788305402.433710:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305402.433738:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.433747:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.433758:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305402.433783:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114496:0@lo:101: 00000100:00100000:3.0:1788305402.433831:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.433939:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114496 00000100:00100000:0.0:1788305402.433950:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114496 00000100:00100000:0.0:1788305402.433998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788305402.434007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eba8d0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:7449:x1875174015114496:12345-0@lo:101: 00010000:00010000:0.0:1788305402.434018:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305402.434029:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b3b5544d/0x4a426866e605317e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053177 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.434051:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b3b5544d/0x4a426866e605317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053177 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.434060:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b3b5544d/0x4a426866e605317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053177 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.434069:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b3b5544d, rc 0) 00000100:00100000:1.0:1788305402.440211:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eba8d0c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114496:12345-0@lo:101: Request processed in 6197us (6371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.440228:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305402.445272:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048ad0157 going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.445341:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114496:0@lo:101: 00010000:00010000:3.0:1788305402.445368:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.445383:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305402.445525:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114624:0@lo:501: 00000100:00100000:3.0:1788305402.445860:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.445931:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048ad0157 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.446483:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114624 00000100:00100000:0.0:1788305402.446493:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114624 00000100:00100000:1.0:1788305402.446710:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788305402.446720:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041724d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114624:12345-0@lo:501: 00000100:00100000:1.0:1788305402.446876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041724d35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114624:12345-0@lo:501: Request processed in 157us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.446884:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305402.447093:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114624:0@lo:501: 00000100:00100000:3.0:1788305402.447163:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114752:0@lo:503: 00000100:00100000:3.0:1788305402.447205:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.447240:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048ad0157 going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.447326:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114752 00000100:00100000:2.0:1788305402.447332:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114752 00000100:00100000:2.0:1788305402.447358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305402.447365:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea91b21c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114752:12345-0@lo:503: 00000100:00100000:2.0:1788305402.447453:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea91b21c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114752:12345-0@lo:503: Request processed in 88us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.447460:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305402.447536:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114752:0@lo:503: 00000040:00080000:3.0:1788305402.447871:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305402.447943:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114880:0@lo:502: 00000100:00100000:3.0:1788305402.447975:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.448008:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3eb1ddc going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.448163:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015114880 00000100:00100000:2.0:1788305402.448168:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015114880 00000100:00100000:2.0:1788305402.448189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305402.448194:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a7f90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114880:12345-0@lo:502: 00000100:00100000:2.0:1788305402.448303:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a7f90c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015114880:12345-0@lo:502: Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.448312:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305402.448509:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015114880:0@lo:502: 00000040:00080000:3.0:1788305402.448651:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788305402.448682:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788305402.448691:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788305402.448699:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788305402.448706:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788305402.448715:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788305402.448722:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788305402.448729:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788305402.448736:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788305402.448746:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788305402.448760:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788305402.448773:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788305402.448787:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788305402.448801:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788305402.448815:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788305402.448823:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788305402.448830:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788305402.448836:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788305402.448848:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788305402.448961:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788305402.448970:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788305402.448977:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788305402.449002:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788305402.449021:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788305402.449047:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788305402.449060:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788305402.449072:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788305402.449084:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788305402.449111:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015115008:0@lo:502: 00000100:00100000:3.0:1788305402.449153:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305402.449223:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3eb1ddc going to sleep for 11 seconds 00000100:00100000:2.0:1788305402.449268:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115008 00000100:00100000:2.0:1788305402.449424:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115008 00000100:00100000:2.0:1788305402.449490:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305402.449499:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ababbab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015115008:12345-0@lo:502: 00000100:00100000:2.0:1788305402.449595:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ababbab1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015115008:12345-0@lo:502: Request processed in 98us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.449603:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305402.449689:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000881dbf96 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015115008:0@lo:502: 00000040:00080000:3.0:1788305402.449733:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788305402.449740:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788305402.450475:0:7468:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788305402.450490:0:7468:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000006e9f552c) 00000020:00000080:3.0:1788305402.450511:0:7468:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788305402.450588:0:7468:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000062330eeb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788305402.450591:0:7468:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000062330eeb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788305402.450594:0:7468:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000062330eeb 3 00010000:00080000:3.0:1788305402.450619:0:7468:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000da0ae16d@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305402.453256:0:7468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788305402.454061:0:7468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788305402.454109:0:7468:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305402.454122:0:7468:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4a426866e605318c 00000100:00080000:2.0:1788305402.454133:0:7468:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305402.454138:0:7468:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000da0ae16d using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305402.454171:0:7468:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008f1e6757 x1875174015115136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305402.454198:0:7468:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305402.454320:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f1e6757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015115136:0@lo:38: 00000100:00100000:3.0:1788305402.454393:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.454517:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115136 00000100:00100000:0.0:1788305402.454525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115136 00000100:00100000:0.0:1788305402.454563:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305402.454571:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000881dbf96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015115136:12345-0@lo:38: 00010000:00080000:0.0:1788305402.454594:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1788305402.454623:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4a426866e6053193 00000004:00100000:0.0:1788305402.454638:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788305402.454665:0:6520:0:(import.c:65:import_set_state_nolock()) 0000000075a6adb5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305402.454727:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000881dbf96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875174015115136:12345-0@lo:38: Request processed in 156us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.454735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305402.454770:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008f1e6757 x1875174015115136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305402.454796:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305402.454803:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788305402.454809:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788305402.454813:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788305402.454816:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000da0ae16d lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788305402.454820:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f1e6757 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015115136:0@lo:38: 00000040:00080000:0.0:1788305402.455354:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788305402.455409:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788305402.455438:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305402.455453:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.455464:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 000000005058483f/0x4a426866e6053177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788305402.455520:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788305402.455523:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.455524:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.455525:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305402.455527:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.455528:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.455529:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.455531:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305402.455532:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305402.455534:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.455535:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788305402.455539:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788305402.455542:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305402.455544:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.455545:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.455546:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305402.455551:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.455552:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.455553:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.455554:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305402.455554:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305402.455556:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.455556:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788305402.455572:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788305402.455583:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015115264:0@lo:253: 00000100:00100000:0.0:1788305402.455624:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.455649:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4050691 going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.455688:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115264 00000100:00100000:0.0:1788305402.455693:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115264 00000100:00100000:0.0:1788305402.455728:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305402.455735:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edbdde63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:7449:x1875174015115264:12345-0@lo:253: 20000000:01000000:0.0:1788305402.455757:0:6513:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788305402.455769:0:6513:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788305402.459432:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788305402.459474:0:6513:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305402.459488:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788305402.459573:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788305402.459578:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788305402.459598:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.459615:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60530b3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.459621:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605315b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.459628:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.459869:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605315b expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.459885:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605315b expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.459897:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015115392:0@lo:104: 00000100:00100000:0.0:1788305402.459972:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305402.460036:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460044:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.460053:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfba0f9d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015115520:0@lo:104: 00000100:00100000:0.0:1788305402.460076:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.460096:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f05d488a going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.460123:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115392 00000100:00100000:0.0:1788305402.460131:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115392 00000100:00100000:0.0:1788305402.460175:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115520 00000100:00100000:0.0:1788305402.460178:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115520 00000100:00100000:0.0:1788305402.460193:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305402.460201:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb045f87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015115392:12345-0@lo:104: 00010000:00010000:0.0:1788305402.460213:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460265:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305402.460270:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb045f87 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015115392:12345-0@lo:104: Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.460304:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305402.460333:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305402.460338:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d624da5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015115520:12345-0@lo:104: 00010000:00010000:0.0:1788305402.460344:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460378:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305402.460382:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d624da5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015115520:12345-0@lo:104: Request processed in 44us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.460388:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788305402.460407:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305402.460413:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460420:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000270c2e0c already unused, calling callback (000000001620736b) 10000000:00010000:0.0:1788305402.460423:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460432:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305402.460438:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305402.460445:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305402.460472:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460479:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305402.460504:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460511:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 00000000270c2e0c/0x4a426866e605315b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053162 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460524:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305402.460526:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460532:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000005731f45 already unused, calling callback (000000001620736b) 10000000:00010000:0.0:1788305402.460534:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460540:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305402.460545:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305402.460550:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305402.460560:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460566:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305402.460577:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460583:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 0000000005731f45/0x4a426866e60530b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60530ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.460594:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305402.460600:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305402.460602:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305402.460621:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015115648:0@lo:103: 00000100:00100000:0.0:1788305402.460649:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 40000000:00080000:3.0:1788305402.461898:0:7469:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:0.0:1788305402.462143:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000134130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015115776:0@lo:103: 00000100:00100000:0.0:1788305402.462200:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.462304:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115648 00000100:00100000:0.0:1788305402.462312:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115648 00010000:00010000:0.0:1788305402.462339:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605315b expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.462371:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115776 00000100:00100000:0.0:1788305402.462374:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115776 00010000:00010000:0.0:1788305402.462385:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.462399:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305402.462406:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efdf1835 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+17:3648:x1875174015115648:12345-0@lo:103: 00000100:00100000:3.0:1788305402.462571:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788305402.462580:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788305402.462696:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305402.462703:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ed7764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015115776:12345-0@lo:103: 00010000:00010000:3.0:1788305402.462714:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305402.462719:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.462729:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 17 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305402.462775:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305402.462818:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ed7764 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015115776:12345-0@lo:103: Request processed in 116us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.462825:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788305402.463080:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305402.463085:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605315b expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463095:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605315b expref: 16 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463108:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463116:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305402.463140:0:6506:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004739607s 00010000:00010000:0.0:1788305402.463144:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463150:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463156:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463162:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463168:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000541ac288 already unused, calling callback (000000005c970c71) 00010000:00010000:0.0:1788305402.463171:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463177:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463184:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463194:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305402.463232:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efdf1835 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+16:3648:x1875174015115648:12345-0@lo:103: Request processed in 827us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.463239:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305402.463324:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000134130ce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015115776:0@lo:103: 00010000:00010000:0.0:1788305402.463365:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f55b4cc9/0x4a426866e6053162 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605315b expref: 15 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.463382:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015115392:0@lo:104: 00010000:00010000:0.0:1788305402.463395:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086ed2092/0x4a426866e60530ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60530b3 expref: 14 pid: 6513 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.463401:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfba0f9d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015115520:0@lo:104: 00010000:00010000:0.0:1788305402.463414:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463421:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463426:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305402.463430:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000541ac288/0x4a426866e605319a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305402.463491:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edbdde63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+13:7449:x1875174015115264:12345-0@lo:253: Request processed in 7757us (7866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.463499:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305402.463534:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:7449:1875174015115264:0@lo:253: 10000000:01000000:0.0:1788305402.463544:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788305402.463547:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305402.463549:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305402.463550:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305402.463552:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305402.463553:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305402.463554:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305402.463555:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305402.463562:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305402.463563:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305402.463565:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305402.463567:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788305402.463577:0:7449:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788305402.463781:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305402.464807:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015115648:0@lo:103: 00080000:10000000:0.0:1788305402.474258:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788305402.474517:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788305402.474853:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788305402.475055:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788305402.475258:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788305402.475443:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788305402.476462:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788305402.476973:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788305402.477146:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788305402.477319:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788305402.477492:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788305402.477633:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:1.0:1788305402.480208:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788305402.480631:0:7475:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788305402.480705:0:7475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875174015115904:0@lo:700: 00000040:01000000:1.0:1788305402.480828:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788305402.480942:0:7475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.481002:0:7475:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a302b18 going to sleep for 11 seconds 00000100:00100000:1.0:1788305402.481059:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015115904 00000100:00100000:1.0:1788305402.481067:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015115904 00000100:00100000:1.0:1788305402.481117:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305402.481125:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfba0f9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875174015115904:12345-0@lo:700: 00000100:00100000:1.0:1788305402.481532:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116032:0@lo:1000: 00000100:00100000:1.0:1788305402.481582:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.481605:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f1c580a4 going to sleep for 11 seconds 00000100:00100000:3.0:1788305402.481650:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116032 00000100:00100000:3.0:1788305402.481655:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116032 00000100:00100000:3.0:1788305402.481692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305402.481698:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a612758f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116032:12345-0@lo:1000: 00000100:00100000:3.0:1788305402.481877:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a612758f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116032:12345-0@lo:1000: Request processed in 178us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305402.481885:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:3.0:1788305402.482233:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788305402.482387:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305402.482879:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116032:0@lo:1000: 00000040:01000000:1.0:1788305402.482918:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788305402.482949:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116160:0@lo:700: 00000100:00100000:1.0:1788305402.482999:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.483035:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116160 00000100:00100000:1.0:1788305402.483041:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116160 00000100:00100000:1.0:1788305402.483075:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305402.483082:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b78638 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116160:12345-0@lo:700: 00000100:00100000:1.0:1788305402.483128:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b78638 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116160:12345-0@lo:700: Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.483134:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305402.483157:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000643fe9ef going to sleep for 11 seconds 00000100:00100000:1.0:1788305402.483171:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116160:0@lo:700: 00000100:00100000:1.0:1788305402.483206:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875174015116288:0@lo:900: 00000100:00100000:1.0:1788305402.483232:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.483258:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116288 00000100:00100000:1.0:1788305402.483262:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116288 00000100:00100000:1.0:1788305402.483303:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305402.483309:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf213879 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875174015116288:12345-0@lo:900: 00000100:00100000:1.0:1788305402.483355:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf213879 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7476:x1875174015116288:12345-0@lo:900: Request processed in 46us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.483361:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305402.483379:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000643fe9ef going to sleep for 11 seconds 00010000:00080000:1.0:1788305402.483391:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002856702d x1875174015116288/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305402.483402:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7476:1875174015116288:0@lo:900: 00000100:00100000:1.0:1788305402.483456:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116416:0@lo:1000: 00000100:00100000:1.0:1788305402.483484:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.483505:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116416 00000100:00100000:1.0:1788305402.483508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116416 00000100:00100000:1.0:1788305402.483538:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305402.483543:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002068db63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116416:12345-0@lo:1000: 00000100:00100000:1.0:1788305402.483598:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002068db63 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116416:12345-0@lo:1000: Request processed in 54us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305402.483604:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305402.483616:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ac241db going to sleep for 11 seconds 00000100:00100000:1.0:1788305402.483625:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116416:0@lo:1000: 00000004:00080000:1.0:1788305402.483657:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000643fe9ef with version 0 00000020:00100000:1.0:1788305402.483670:0:7476:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788305402.483674:0:7476:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000002856702d x1875174015116672/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305402.483685:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116672:0@lo:1000: 00000100:00100000:1.0:1788305402.483707:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305402.483722:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116672 00000100:00100000:1.0:1788305402.483732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116672 00000100:00100000:1.0:1788305402.484019:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305402.484026:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e2f1b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116672:12345-0@lo:1000: 00000100:00100000:1.0:1788305402.484368:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 0000000048373dc9 going to sleep for 11 seconds 00000004:00000080:3.0:1788305402.488205:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788305402.488245:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788305402.488523:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305402.489643:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:2.0:1788305402.489967:0:7474:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788305402.489972:0:7474:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000001:00080000:2.0:1788305402.492083:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000040:00080000:3.0:1788305402.492474:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788305402.492561:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788305402.492817:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788305402.493034:0:7449:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788305402.493670:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788305402.493829:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788305402.493964:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788305402.494124:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788305402.494299:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788305402.494526:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788305402.494659:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788305402.494789:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788305402.494934:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788305402.495095:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788305402.495239:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788305402.495395:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788305402.495592:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788305402.495734:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788305402.495859:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 40000000:02000000:2.0:1788305402.496475:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:3.0:1788305402.498035:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788305402.498532:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788305402.500297:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788305402.500572:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788305402.500758:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788305402.500891:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788305402.501037:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788305402.501182:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788305402.501389:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788305402.501529:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788305402.501673:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788305402.501809:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788305402.501963:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788305402.502113:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788305402.502260:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788305402.502432:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788305402.502626:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788305402.502825:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788305402.504198:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e2f1b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116672:12345-0@lo:1000: Request processed in 20165us (20482us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788305402.504216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305402.505940:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfba0f9d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7475:x1875174015115904:12345-0@lo:700: Request processed in 24809us (24992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305402.505960:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:0.0:1788305402.506875:0:7476:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788305402.506883:0:7476:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788305402.506900:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002856702d pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116672:0@lo:1000: 00000100:00100000:0.0:1788305402.507904:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116800:0@lo:1000: 00000100:00100000:0.0:1788305402.507965:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305402.508023:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015116800 00000100:00100000:0.0:1788305402.508029:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015116800 00000100:00100000:0.0:1788305402.508074:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305402.508083:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000134130ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116800:12345-0@lo:1000: 00000100:00100000:0.0:1788305402.508153:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000134130ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7476:x1875174015116800:12345-0@lo:1000: Request processed in 71us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305402.508160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305402.508201:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bdfa9fba going to sleep for 11 seconds 00000100:00100000:0.0:1788305402.508219:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7476:1875174015116800:0@lo:1000: 00000040:00080000:0.0:1788305402.508244:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788305402.508271:0:7476:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000b4982593 with version 1 00000004:00080000:2.0:1788305402.508786:0:7465:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000885963e2 version 1 rpc_version 1 00000020:00100000:2.0:1788305402.508808:0:7465:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788305402.508815:0:7465:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c75ef688 x1875174015117056/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305402.508830:0:7465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c75ef688 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875174015117056:0@lo:1000: 00000100:00100000:2.0:1788305402.508867:0:7465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305402.508898:0:7465:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b832ae4 going to sleep for 11 seconds 00010000:00080000:1.0:1788305402.513357:0:7475:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005f575729 x1875174015115904/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788305418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305402.513379:0:7475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f575729 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7475:1875174015115904:0@lo:700: 40000000:02000000:1.0:1788305402.513394:0:7475:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:3.0:1788305402.515171:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788305402.515214:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff94a3c191f988 00100000:10000000:3.0:1788305402.515224:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1788305402.515869:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788305402.515933:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1788305402.515978:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117056 00000100:00100000:0.0:1788305402.518192:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117056 00000100:00100000:0.0:1788305402.518270:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305402.518304:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca987a14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875174015117056:12345-0@lo:1000: 00000020:01000004:2.0:1788305402.522598:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788305402.522634:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788305402.522666:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788305402.522709:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788305402.524569:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305402.527157:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000001:00080000:0.0:1788305402.534619:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788305402.534774:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca987a14 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7465:x1875174015117056:12345-0@lo:1000: Request processed in 16469us (25903us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788305402.534788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788305402.536013:0:7465:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788305402.536020:0:7465:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788305402.536039:0:7465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c75ef688 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7465:1875174015117056:0@lo:1000: 00000040:00080000:2.0:1788305402.563963:0:7475:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305402.573509:0:7475:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788305402.573591:0:7475:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788305402.573596:0:7475:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788305402.969365:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305403.999411:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305405.017487:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305406.040887:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305407.069020:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305407.370799:0:7721:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788305407.445325:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305407.445334:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891894cd800 from 4 10000000:01000000:0.0:1788305407.445339:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305407.445390:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.445404:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.445414:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305407.445438:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117184:0@lo:101: 00000100:00100000:0.0:1788305407.445513:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.445573:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c05b6748 going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.445645:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117184 00000100:00100000:1.0:1788305407.445654:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117184 00000100:00100000:1.0:1788305407.445898:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305407.445908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007376b2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:6516:x1875174015117184:12345-0@lo:101: 00010000:00010000:1.0:1788305407.445921:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305407.445949:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072fc49a8/0x4a426866e60531a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60531a1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.445973:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072fc49a8/0x4a426866e60531a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60531a1 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.445989:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072fc49a8/0x4a426866e60531a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531a1 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.445998:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072fc49a8, rc 0) 00000100:00100000:1.0:1788305407.446045:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007376b2d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:6516:x1875174015117184:12345-0@lo:101: Request processed in 139us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.446056:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305407.446242:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c75ef688 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015117312:0@lo:41: 00000100:00100000:2.0:1788305407.446289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.447384:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117312 00000100:00100000:0.0:1788305407.447396:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117312 00000100:00100000:0.0:1788305407.447448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305407.447465:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000929abac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015117312:12345-0@lo:41: 00000004:00000024:0.0:1788305407.447512:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788305407.447576:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000929abac pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015117312:12345-0@lo:41: Request processed in 122us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305407.447583:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305407.447684:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c75ef688 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015117312:0@lo:41: 00000100:00100000:1.0:1788305407.448924:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1ee0e56 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117184:0@lo:101: 00010000:00010000:1.0:1788305407.448957:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.448970:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305407.449035:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6379ba1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117440:0@lo:256: 00000100:00100000:1.0:1788305407.449089:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.449140:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117440 00000100:00100000:3.0:1788305407.449155:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117440 00000100:00100000:3.0:1788305407.449194:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305407.449201:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003a7fbc3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:6516:x1875174015117440:12345-0@lo:256: 00000100:00100000:1.0:1788305407.449210:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b590353 going to sleep for 11 seconds 20000000:01000000:3.0:1788305407.449217:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788305407.449231:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788305407.449234:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788305407.449339:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003a7fbc3e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:6516:x1875174015117440:12345-0@lo:256: Request processed in 138us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.449347:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305407.449868:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6379ba1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117440:0@lo:256: 10000000:01000000:1.0:1788305407.449933:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305407.449953:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.449962:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000061bd1817/0x4a426866e60531a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305407.449973:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788305407.449976:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a3800 from 21 10000000:01000000:1.0:1788305407.449979:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305407.450008:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.450016:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.450035:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305407.450049:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e6379ba1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117568:0@lo:101: 00000100:00100000:1.0:1788305407.450080:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.450207:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b590353 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.451621:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117568 00000100:00100000:3.0:1788305407.451632:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117568 00000100:00100000:3.0:1788305407.451677:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305407.451686:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd05065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:6516:x1875174015117568:12345-0@lo:101: 00010000:00010000:3.0:1788305407.451701:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305407.451716:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000035abbc1a/0x4a426866e60531b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60531af expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.451752:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035abbc1a/0x4a426866e60531b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.451762:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000035abbc1a/0x4a426866e60531b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.451771:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000035abbc1a, rc 0) 00000100:00100000:3.0:1788305407.451831:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd05065 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015117568:12345-0@lo:101: Request processed in 146us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.451838:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305407.460172:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e6379ba1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117568:0@lo:101: 00010000:00010000:0.0:1788305407.460206:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.460219:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305407.460323:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117696:0@lo:501: 00000100:00100000:0.0:1788305407.460387:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.460428:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8118ee9 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.461715:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117696 00000100:00100000:3.0:1788305407.461728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117696 00000100:00100000:3.0:1788305407.461821:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305407.461831:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd2380f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015117696:12345-0@lo:501: 00000100:00100000:3.0:1788305407.461999:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd2380f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015117696:12345-0@lo:501: Request processed in 170us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.462008:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305407.462075:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117696:0@lo:501: 00000100:00100000:0.0:1788305407.462121:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117824:0@lo:503: 00000100:00100000:0.0:1788305407.462185:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.462216:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b8118ee9 going to sleep for 11 seconds 00000100:00100000:0.0:1788305407.462768:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117824 00000100:00100000:0.0:1788305407.462775:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117824 00000100:00100000:0.0:1788305407.462815:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305407.462822:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000164d1564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015117824:12345-0@lo:503: 00000100:00100000:0.0:1788305407.462922:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000164d1564 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015117824:12345-0@lo:503: Request processed in 100us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305407.462929:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305407.462982:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015117824:0@lo:503: 00000100:00100000:1.0:1788305407.466650:0:7727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036d15aea pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7727:1875174015117952:0@lo:502: 00000100:00100000:1.0:1788305407.466737:0:7727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.466780:0:7727:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092ab73b3 going to sleep for 11 seconds 00000100:00100000:0.0:1788305407.466830:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015117952 00000100:00100000:0.0:1788305407.466837:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015117952 00000100:00100000:0.0:1788305407.466886:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305407.466894:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019a1252c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:7727:x1875174015117952:12345-0@lo:502: 00000100:00100000:0.0:1788305407.467042:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019a1252c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:7727:x1875174015117952:12345-0@lo:502: Request processed in 149us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305407.467050:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305407.467136:0:7727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036d15aea pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7727:1875174015117952:0@lo:502: 00000100:00100000:3.0:1788305407.467183:0:7727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecea7e30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7727:1875174015118080:0@lo:502: 00000100:00100000:3.0:1788305407.467215:0:7727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.467242:0:7727:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cad048f6 going to sleep for 11 seconds 00000100:00100000:0.0:1788305407.467394:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118080 00000100:00100000:0.0:1788305407.467398:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118080 00000100:00100000:0.0:1788305407.467423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305407.467429:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b12d141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:7727:x1875174015118080:12345-0@lo:502: 00000100:00100000:0.0:1788305407.467496:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b12d141 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:7727:x1875174015118080:12345-0@lo:502: Request processed in 67us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305407.467502:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305407.467661:0:7727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecea7e30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7727:1875174015118080:0@lo:502: 00000040:00080000:3.0:1788305407.467679:0:7727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788305407.467839:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788305407.467862:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305407.467870:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.467880:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000757ec440/0x4a426866e60531af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305407.467890:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305407.467898:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a3800 from 4 10000000:01000000:0.0:1788305407.467901:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305407.467926:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.467945:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.467954:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305407.467967:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118208:0@lo:101: 00000100:00100000:0.0:1788305407.467995:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.468027:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bfaac06e going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.468094:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118208 00000100:00100000:1.0:1788305407.468099:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118208 00000100:00100000:1.0:1788305407.468133:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305407.468140:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f30ee7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015118208:12345-0@lo:101: 00010000:00010000:1.0:1788305407.468149:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305407.468161:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000d9419cb/0x4a426866e60531c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60531bd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468179:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000d9419cb/0x4a426866e60531c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60531bd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468189:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000d9419cb/0x4a426866e60531c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531bd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468199:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000d9419cb, rc 0) 00000100:00100000:1.0:1788305407.468232:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f30ee7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015118208:12345-0@lo:101: Request processed in 93us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.468238:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305407.468309:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118208:0@lo:101: 00010000:00010000:1.0:1788305407.468320:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468328:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305407.468373:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118336:0@lo:256: 00000100:00100000:1.0:1788305407.468402:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.468416:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a295afef going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.468428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118336 00000100:00100000:1.0:1788305407.468431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118336 00000100:00100000:1.0:1788305407.468449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305407.468454:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011380367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015118336:12345-0@lo:256: 20000000:01000000:1.0:1788305407.468468:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305407.468483:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305407.468486:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788305407.468561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011380367 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015118336:12345-0@lo:256: Request processed in 107us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.468568:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305407.468595:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118336:0@lo:256: 10000000:01000000:1.0:1788305407.468634:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305407.468639:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468645:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000097b2a16b/0x4a426866e60531bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305407.468662:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788305407.468663:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788305407.468666:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305407.468679:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468688:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468695:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305407.468706:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118464:0@lo:101: 00000100:00100000:1.0:1788305407.468730:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.468743:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a295afef going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.468754:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118464 00000100:00100000:1.0:1788305407.468757:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118464 00000100:00100000:1.0:1788305407.468773:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305407.468779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a412f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015118464:12345-0@lo:101: 00010000:00010000:1.0:1788305407.468786:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305407.468793:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058dc166a/0x4a426866e60531d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60531cb expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468805:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058dc166a/0x4a426866e60531d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60531cb expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468813:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058dc166a/0x4a426866e60531d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531cb expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468831:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058dc166a, rc 0) 00000100:00100000:1.0:1788305407.468860:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a412f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015118464:12345-0@lo:101: Request processed in 81us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.468865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305407.468890:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118464:0@lo:101: 00010000:00010000:1.0:1788305407.468898:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.468905:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305407.468967:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118592:0@lo:501: 00000100:00100000:1.0:1788305407.468991:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.469002:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a295afef going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.469011:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118592 00000100:00100000:1.0:1788305407.469013:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118592 00000100:00100000:1.0:1788305407.469028:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305407.469032:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de086384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015118592:12345-0@lo:501: 00000100:00100000:1.0:1788305407.469139:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de086384 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015118592:12345-0@lo:501: Request processed in 107us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.469145:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305407.469168:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118592:0@lo:501: 00000100:00100000:1.0:1788305407.469191:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118720:0@lo:503: 00000100:00100000:1.0:1788305407.469223:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.469233:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a295afef going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.469247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118720 00000100:00100000:1.0:1788305407.469251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118720 00000100:00100000:1.0:1788305407.469265:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305407.469270:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef5abbe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015118720:12345-0@lo:503: 00000100:00100000:1.0:1788305407.469370:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef5abbe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015118720:12345-0@lo:503: Request processed in 100us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.469377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305407.469412:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015118720:0@lo:503: 00000100:00100000:1.0:1788305407.469585:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7729:1875174015118848:0@lo:502: 00000100:00100000:1.0:1788305407.469618:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.469636:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118848 00000100:00100000:1.0:1788305407.469640:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118848 00000100:00100000:1.0:1788305407.469656:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305407.469662:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d2dacf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7729:x1875174015118848:12345-0@lo:502: 00000100:00100000:1.0:1788305407.469727:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d2dacf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7729:x1875174015118848:12345-0@lo:502: Request processed in 65us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.469735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305407.469761:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b590353 going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.469773:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7729:1875174015118848:0@lo:502: 00000020:01000000:1.0:1788305407.469792:0:7729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305407.469802:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305407.469805:0:7729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788305407.469809:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305407.469813:0:7729:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:1.0:1788305407.469836:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305407.469852:0:7729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000ffa87af0) 00000020:00000080:1.0:1788305407.469872:0:7729:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788305407.469882:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305407.469981:0:7729:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788305407.469987:0:7729:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788305407.469994:0:7729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e60531e0 00010000:00080000:1.0:1788305407.470021:0:7729:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000284c5fdc@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305407.472718:0:7729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:3.0:1788305407.473836:0:7729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305407.473849:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788305407.473888:0:7729:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788305407.473908:0:7729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e60531e7 00000100:00080000:3.0:1788305407.473918:0:7729:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305407.473923:0:7729:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000284c5fdc using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305407.473968:0:7729:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ecea7e30 x1875174015118976/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305407.474029:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ecea7e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015118976:0@lo:38: 00000100:00100000:0.0:1788305407.474111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.474203:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015118976 00000100:00100000:1.0:1788305407.474211:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015118976 00000100:00100000:1.0:1788305407.474255:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305407.474263:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efdf1835 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015118976:12345-0@lo:38: 00010000:00080000:1.0:1788305407.474337:0:6525:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1788305407.474366:0:6525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e60531ee 00000004:00100000:1.0:1788305407.474381:0:6525:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788305407.474387:0:6525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788305407.478190:0:7729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788305407.478425:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015119104:0@lo:400: 00000100:00100000:1.0:1788305407.478498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.478535:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305407.478542:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000088c067f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015119232:0@lo:400: 00000100:00100000:1.0:1788305407.478567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.478608:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119104 00000100:00100000:1.0:1788305407.478614:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119104 00000100:00100000:1.0:1788305407.478653:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119232 00000100:00100000:1.0:1788305407.478656:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119232 00000100:00100000:1.0:1788305407.478671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305407.478678:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ab5eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015119104:12345-0@lo:400: 00000100:00100000:1.0:1788305407.478726:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ab5eb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015119104:12345-0@lo:400: Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.478734:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305407.478767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305407.478772:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89e5212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015119232:12345-0@lo:400: 00000100:00100000:1.0:1788305407.478799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89e5212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015119232:12345-0@lo:400: Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.478804:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788305407.478848:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000088c067f2 x1875174015119232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305407.478862:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000088c067f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015119232:0@lo:400: 00010000:00080000:1.0:1788305407.478873:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d7dcd416 x1875174015119104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305407.478881:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015119104:0@lo:400: 00000040:01000000:3.0:1788305407.479046:0:7729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788305407.479551:0:7732:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000008dca42f x1875174015119360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305407.479560:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e6c9152 going to sleep for 0 seconds 00000020:01000000:1.0:1788305407.479657:0:7729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305407.479664:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305407.479666:0:7729:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788305407.479669:0:7729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305407.479674:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305407.479675:0:7729:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305407.479678:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305407.479679:0:7729:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788305407.479701:0:7729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7729:1875174015119488:0@lo:502: 00000100:00100000:1.0:1788305407.479748:0:7729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.479784:0:7729:0:(client.c:2715:ptlrpc_set_wait()) set 000000007f2a588f going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.479830:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119488 00000100:00100000:3.0:1788305407.479836:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119488 00000100:00100000:3.0:1788305407.479877:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305407.479884:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eeebf99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7729:x1875174015119488:12345-0@lo:502: 00000100:00100000:3.0:1788305407.479998:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eeebf99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7729:x1875174015119488:12345-0@lo:502: Request processed in 114us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.480006:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305407.480168:0:7729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7729:1875174015119488:0@lo:502: 00000020:01000000:1.0:1788305407.480189:0:7729:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305407.480193:0:7729:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305407.480194:0:7729:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788305407.480197:0:7729:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788305407.480494:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788305407.480529:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305407.480538:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.480548:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 00000000f4c5a2ea/0x4a426866e60531cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305407.480557:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788305407.480560:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889186788000 from 1 10000000:01000000:0.0:1788305407.480563:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305407.480584:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.480590:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.480606:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305407.480618:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e10b80a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015119616:0@lo:101: 00000100:00100000:0.0:1788305407.480649:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.480716:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000002af4b6c1 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.483468:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119616 00000100:00100000:3.0:1788305407.483483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119616 00000100:00100000:3.0:1788305407.483579:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788305407.483588:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee7d45fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015119616:12345-0@lo:101: 00010000:00010000:3.0:1788305407.483604:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305407.483620:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e8250db/0x4a426866e60531fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60531f5 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.483647:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e8250db/0x4a426866e60531fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60531f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.483668:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e8250db/0x4a426866e60531fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305407.483677:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e8250db, rc 0) 00000100:00100000:3.0:1788305407.483754:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee7d45fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015119616:12345-0@lo:101: Request processed in 167us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.483760:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305407.483826:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e10b80a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015119616:0@lo:101: 00010000:00010000:0.0:1788305407.483843:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305407.483851:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305407.483915:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e10b80a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015119744:0@lo:501: 00000100:00100000:0.0:1788305407.483961:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.488257:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000002af4b6c1 going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.492422:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119744 00000100:00100000:1.0:1788305407.492438:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119744 00000100:00100000:1.0:1788305407.492500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305407.492510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b986ca46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015119744:12345-0@lo:501: 00000100:00100000:1.0:1788305407.492655:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b986ca46 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015119744:12345-0@lo:501: Request processed in 146us (8693us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305407.492663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305407.492731:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e10b80a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015119744:0@lo:501: 10000000:01000000:1.0:1788305407.492774:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788305407.492783:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305407.492794:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: 0000000062872db1/0x4a426866e60531f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788305407.494675:0:6525:0:(import.c:65:import_set_state_nolock()) 000000007cd5145b : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305407.494864:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efdf1835 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015118976:12345-0@lo:38: Request processed in 20600us (20752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305407.494875:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305407.494951:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305407.494961:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788305407.494969:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788305407.494973:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788305407.494975:0:3646:0:(import.c:65:import_set_state_nolock()) 00000000284c5fdc lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788305407.495024:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006e6c9152): req@0000000008dca42f x1875174015119360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305407.495046:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ecea7e30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015118976:0@lo:38: 00000100:00100000:0.0:1788305407.495128:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.495170:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e6c9152 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.495206:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119360 00000100:00100000:3.0:1788305407.495211:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119360 00000100:00100000:3.0:1788305407.495252:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305407.495259:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000df7af9e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015119360:12345-0@lo:1000: 00000100:00100000:3.0:1788305407.495342:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000df7af9e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015119360:12345-0@lo:1000: Request processed in 84us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.495349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305407.495372:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015119360:0@lo:1000: 00000040:01000000:3.0:1788305407.495405:0:7732:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788305407.495443:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015119872:0@lo:1000: 00000100:00100000:3.0:1788305407.495483:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.495502:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015119872 00000100:00100000:3.0:1788305407.495505:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015119872 00000100:00100000:3.0:1788305407.495519:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305407.495523:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecea7e30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015119872:12345-0@lo:1000: 00000100:00100000:3.0:1788305407.495592:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecea7e30 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015119872:12345-0@lo:1000: Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.495598:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305407.495610:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000003533da92 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.495620:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015119872:0@lo:1000: 00000100:00100000:3.0:1788305407.495650:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120000:0@lo:700: 00000100:00100000:3.0:1788305407.495670:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.495687:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 0000000011457a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.495966:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120000 00000100:00100000:1.0:1788305407.495971:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120000 00000100:00100000:1.0:1788305407.496032:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305407.496039:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc28fcba pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015120000:12345-0@lo:700: 00000100:00100000:1.0:1788305407.496089:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc28fcba pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015120000:12345-0@lo:700: Request processed in 51us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.496094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305407.496141:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120000:0@lo:700: 00000100:00100000:3.0:1788305407.496319:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120128:0@lo:1000: 00000100:00100000:3.0:1788305407.496345:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.496364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120128 00000100:00100000:3.0:1788305407.496367:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120128 00000100:00100000:3.0:1788305407.496391:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305407.496396:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b41ceb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015120128:12345-0@lo:1000: 00000100:00100000:3.0:1788305407.496438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b41ceb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015120128:12345-0@lo:1000: Request processed in 41us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305407.496444:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305407.496459:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e6c9152 going to sleep for 11 seconds 00000100:00100000:3.0:1788305407.496469:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120128:0@lo:1000: 00000004:00080000:3.0:1788305407.496504:0:7732:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000011457a80 with version 0 00000020:00100000:3.0:1788305407.496525:0:7732:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788305407.496530:0:7732:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000008dca42f x1875174015120384/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305407.496542:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120384:0@lo:1000: 00000100:00100000:3.0:1788305407.496565:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.496580:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120384 00000100:00100000:3.0:1788305407.496583:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120384 00000100:00100000:3.0:1788305407.496599:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788305407.496603:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7dd7660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7732:x1875174015120384:12345-0@lo:1000: 00000100:00100000:3.0:1788305407.496890:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef86eefc going to sleep for 11 seconds 00000100:00100000:0.0:1788305407.497730:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305407.497745:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015120512:0@lo:41: 00000100:00100000:0.0:1788305407.497787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305407.497914:0:6525:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788305407.497923:0:6525:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788305407.498445:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120512 00000100:00100000:3.0:1788305407.498451:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120512 00000100:00100000:1.0:1788305407.498601:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305407.498611:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e10b80a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875174015120512:12345-0@lo:41: 00000004:00000024:1.0:1788305407.498639:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788305407.498793:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e10b80a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:3650:x1875174015120512:12345-0@lo:41: Request processed in 185us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.498809:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305407.498869:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015120512:0@lo:41: 00000001:00080000:0.0:1788305407.509296:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788305407.509496:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788305407.509717:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7dd7660 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7732:x1875174015120384:12345-0@lo:1000: Request processed in 13108us (13147us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788305407.509732:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788305407.509788:0:7732:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788305407.509793:0:7732:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788305407.509808:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000008dca42f pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120384:0@lo:1000: 00000100:00100000:0.0:1788305407.509901:0:7732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120640:0@lo:1000: 00000100:00100000:0.0:1788305407.509950:0:7732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305407.509980:0:7732:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c1c97e7 going to sleep for 11 seconds 00000100:00100000:1.0:1788305407.510379:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120640 00000100:00100000:1.0:1788305407.510386:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120640 00000100:00100000:1.0:1788305407.510426:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305407.510434:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1ee0e56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1875174015120640:12345-0@lo:1000: 00000100:00100000:1.0:1788305407.510512:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1ee0e56 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7732:x1875174015120640:12345-0@lo:1000: Request processed in 79us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305407.510519:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305407.510542:0:7732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099b85f64 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7732:1875174015120640:0@lo:1000: 00000040:00080000:3.0:1788305407.510561:0:7732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788305407.510591:0:7732:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000060e5c4de with version 1 00000004:00080000:1.0:1788305407.511427:0:7730:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000002fa034af version 1 rpc_version 1 00000020:00100000:1.0:1788305407.511450:0:7730:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788305407.511468:0:7730:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d7dcd416 x1875174015120896/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305407.511485:0:7730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7730:1875174015120896:0@lo:1000: 00000100:00100000:1.0:1788305407.511527:0:7730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305407.511552:0:7730:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e89c5f1 going to sleep for 11 seconds 00000100:00100000:0.0:1788305407.512181:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015120896 00000100:00100000:0.0:1788305407.512189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015120896 00000100:00100000:0.0:1788305407.512241:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305407.512250:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000088c067f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7730:x1875174015120896:12345-0@lo:1000: 00000040:00080000:3.0:1788305407.519216:0:7732:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788305407.519516:0:7732:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788305407.519521:0:7732:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788305407.519842:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788305407.520021:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000088c067f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7730:x1875174015120896:12345-0@lo:1000: Request processed in 7769us (8489us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788305407.520033:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788305407.520125:0:7730:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788305407.520130:0:7730:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788305407.520147:0:7730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7dcd416 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7730:1875174015120896:0@lo:1000: 00010000:00010000:1.0:1788305408.086549:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305408.448479:0:7779:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305408.449863:0:7779:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305409.110299:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305410.134054:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305411.165767:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305411.415216:0:7880:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305411.415639:0:7880:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788305412.182376:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305412.565408:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000415db451 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015121024:0@lo:41: 00000100:00100000:0.0:1788305412.565499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.565571:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121024 00000100:00100000:3.0:1788305412.565579:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121024 00000100:00100000:3.0:1788305412.565629:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305412.565646:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f575729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015121024:12345-0@lo:41: 00000004:00000024:3.0:1788305412.565698:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788305412.565741:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f575729 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015121024:12345-0@lo:41: Request processed in 97us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305412.565748:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305412.566148:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015121536:0@lo:400: 00000100:00100000:0.0:1788305412.566176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.566188:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015121152:0@lo:41: 00000100:00100000:1.0:1788305412.566230:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015121408:0@lo:400: 00000100:00100000:0.0:1788305412.566565:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000415db451 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015121024:0@lo:41: 00000100:00100000:0.0:1788305412.566595:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121536 00000100:00100000:0.0:1788305412.566600:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121536 00000100:00100000:0.0:1788305412.566626:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305412.566632:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a51689ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015121536:12345-0@lo:400: 00000100:00100000:3.0:1788305412.572498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.572571:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000875b6a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015121664:0@lo:400: 00000100:00100000:3.0:1788305412.572908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.572947:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305412.572954:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015121280:0@lo:400: 00000100:00100000:3.0:1788305412.572997:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.573048:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121664 00000100:00100000:3.0:1788305412.573126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121664 00000100:00100000:3.0:1788305412.573178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305412.573186:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008dca42f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015121664:12345-0@lo:400: 00000100:00100000:3.0:1788305412.573235:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008dca42f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015121664:12345-0@lo:400: Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305412.573243:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788305412.573842:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000875b6a7b x1875174015121664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305412.573859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000875b6a7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015121664:0@lo:400: 00000100:00100000:1.0:1788305412.574597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121280 00000100:00100000:1.0:1788305412.574607:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121280 00000100:00100000:1.0:1788305412.574663:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305412.574671:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d655e24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:3647:x1875174015121280:12345-0@lo:400: 00000100:00100000:1.0:1788305412.574730:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d655e24 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:3647:x1875174015121280:12345-0@lo:400: Request processed in 61us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305412.574738:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305412.574787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.574839:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121408 00000100:00100000:3.0:1788305412.574844:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121408 00000100:00100000:3.0:1788305412.574880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305412.574886:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089967795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015121408:12345-0@lo:400: 00000100:00100000:3.0:1788305412.574938:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089967795 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015121408:12345-0@lo:400: Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305412.574943:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305412.574971:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015121280:0@lo:400: 00010000:00080000:3.0:1788305412.574993:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a59ae696 x1875174015121408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305412.575010:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015121408:0@lo:400: 00000100:00100000:1.0:1788305412.577583:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121152 00000100:00100000:1.0:1788305412.577596:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121152 00000100:00100000:1.0:1788305412.577636:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305412.577645:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000415db451 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015121152:12345-0@lo:41: 00000004:00000024:1.0:1788305412.577679:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788305412.577762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000415db451 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015121152:12345-0@lo:41: Request processed in 119us (5271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305412.577770:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305412.577803:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015121152:0@lo:41: 00000100:00100000:0.0:1788305412.582705:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a51689ff pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015121536:12345-0@lo:400: Request processed in 16063us (16519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305412.582721:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788305412.582827:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015121536:0@lo:400: 00000020:00000080:2.0:1788305412.706897:0:7929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd3c13fe0 20000000:00000080:2.0:1788305412.706915:0:7929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891badf6c00 uarg=0000000000000000 20000000:01000000:2.0:1788305412.706963:0:7929:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788305412.706970:0:7929:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788305412.706977:0:7929:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788305412.707052:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788305412.711140:0:7929:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788305412.716000:0:7929:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305412.716247:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788305412.716310:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788305412.716328:0:7929:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788305412.716344:0:7929:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788305412.716362:0:7929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716380:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605307b expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716387:0:7929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716393:0:7929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716428:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716440:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305412.716453:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875174015121792:0@lo:104: 00000100:00100000:0.0:1788305412.716521:0:7929:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305412.716578:0:7929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605307b expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.716598:0:7929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605307b expref: 17 pid: 6513 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305412.716606:0:7929:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875174015121920:0@lo:104: 00000100:00100000:0.0:1788305412.716626:0:7929:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019874cfb going to sleep for 11 seconds 00000100:00100000:2.0:1788305412.721135:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788305412.721182:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305412.721232:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121792 00000100:00100000:2.0:1788305412.721240:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121792 00000100:00100000:0.0:1788305412.721616:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015121920 00000100:00100000:0.0:1788305412.721621:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015121920 00000100:00100000:0.0:1788305412.721655:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305412.721664:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000736dbfa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:7929:x1875174015121920:12345-0@lo:104: 00010000:00010000:0.0:1788305412.721680:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305412.721765:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305412.721771:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000736dbfa1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:7929:x1875174015121920:12345-0@lo:104: Request processed in 109us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305412.721778:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788305412.721898:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305412.721904:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305412.721912:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000de6e627 already unused, calling callback (000000001620736b) 10000000:00010000:1.0:1788305412.721915:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305412.721923:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305412.721945:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305412.721951:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305412.721991:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305412.721997:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305412.722016:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305412.722022:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 000000000de6e627/0x4a426866e605307b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053082 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305412.722036:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305412.722037:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305412.722038:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305412.722051:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015122048:0@lo:103: 00000100:00100000:1.0:1788305412.722097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305412.722247:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122048 00000100:00100000:3.0:1788305412.722252:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122048 00010000:00010000:3.0:1788305412.722309:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605307b expref: 18 pid: 6513 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305412.722332:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305412.722338:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7dcd416 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+18:3648:x1875174015122048:12345-0@lo:103: 00010000:00010000:3.0:1788305412.722349:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305412.722353:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605307b expref: 18 pid: 6513 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305412.722362:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605307b expref: 18 pid: 6513 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305412.722378:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305412.722403:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7dcd416 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+18:3648:x1875174015122048:12345-0@lo:103: Request processed in 66us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305412.722409:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788305412.722442:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae7740e3/0x4a426866e6053082 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605307b expref: 17 pid: 6513 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305412.722452:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a59ae696 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875174015121920:0@lo:104: 00000100:00100000:2.0:1788305412.722790:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305412.722799:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001cd03625 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:7929:x1875174015121792:12345-0@lo:104: 00010000:00010000:2.0:1788305412.722814:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.722855:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305412.722860:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001cd03625 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:7929:x1875174015121792:12345-0@lo:104: Request processed in 63us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305412.722866:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788305412.725457:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305412.725469:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725491:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a5b339c already unused, calling callback (000000001620736b) 10000000:00010000:2.0:1788305412.725495:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725504:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305412.725510:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305412.725515:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305412.725559:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725567:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305412.725592:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725599:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: 000000002a5b339c/0x4a426866e6053169 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053170 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725630:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305412.725632:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305412.725634:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305412.725659:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab8288cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015122176:0@lo:103: 00000100:00100000:2.0:1788305412.725726:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305412.725792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122176 00000100:00100000:2.0:1788305412.725800:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122176 00010000:00010000:2.0:1788305412.725825:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305412.725851:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305412.725859:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c75ef688 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015122176:12345-0@lo:103: 00010000:00010000:2.0:1788305412.725872:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305412.725877:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725905:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 17 pid: 6512 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725921:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725928:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725942:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725948:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725960:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725966:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725971:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c8adab93 already unused, calling callback (000000005c970c71) 00010000:00010000:2.0:1788305412.725974:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725980:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725988:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.725997:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305412.726032:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c75ef688 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015122176:12345-0@lo:103: Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305412.726040:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305412.726079:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab8288cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015122176:0@lo:103: 00010000:00010000:2.0:1788305412.726938:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e09a2e52/0x4a426866e6053170 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053169 expref: 16 pid: 6512 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305412.726953:0:7929:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f837fad pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7929:1875174015121792:0@lo:104: 00010000:00010000:2.0:1788305412.726971:0:7929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.726979:0:7929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.726995:0:7929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305412.727000:0:7929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c8adab93/0x4a426866e6053203 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305412.729447:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015122048:0@lo:103: 00010000:00010000:1.0:1788305413.205494:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305414.231907:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788305414.742272:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305414.742297:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cd800 from 1 10000000:01000000:0.0:1788305414.742304:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305414.742358:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: 00000000c8adab93/0x4a426866e605320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.742371:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: 00000000c8adab93/0x4a426866e605320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.742383:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: 00000000c8adab93/0x4a426866e605320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305414.742427:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122304:0@lo:101: 00000100:00100000:0.0:1788305414.742500:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305414.742560:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000004deb2a88 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.746494:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122304 00000100:00100000:3.0:1788305414.746516:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122304 00000100:00100000:3.0:1788305414.746608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305414.746656:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0e56a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015122304:12345-0@lo:101: 00010000:00010000:3.0:1788305414.746681:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305414.746724:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000043668e6c/0x4a426866e6053211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605320a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305414.746760:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000043668e6c/0x4a426866e6053211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605320a expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305414.746773:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000043668e6c/0x4a426866e6053211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605320a expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305414.746785:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000043668e6c, rc 0) 00000100:00100000:3.0:1788305414.747077:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0e56a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122304:12345-0@lo:101: Request processed in 423us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.747086:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305414.747164:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000574dfe5a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122304:0@lo:101: 00010000:00010000:3.0:1788305414.747188:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: 00000000c8adab93/0x4a426866e605320a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305414.747198:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: 00000000c8adab93/0x4a426866e605320a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305414.747375:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122432:0@lo:501: 00000100:00100000:3.0:1788305414.747421:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305414.747459:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000005926f9b2 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.747476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122432 00000100:00100000:3.0:1788305414.747479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122432 00000100:00100000:3.0:1788305414.747507:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305414.747513:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de90f2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122432:12345-0@lo:501: 00000100:00100000:3.0:1788305414.747672:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de90f2f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122432:12345-0@lo:501: Request processed in 159us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.747680:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305414.748116:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122432:0@lo:501: 00000100:00100000:3.0:1788305414.748156:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122560:0@lo:503: 00000100:00100000:3.0:1788305414.748973:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305414.749021:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set 000000005926f9b2 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.749052:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122560 00000100:00100000:3.0:1788305414.749059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122560 00000100:00100000:3.0:1788305414.749109:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305414.749118:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb889a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122560:12345-0@lo:503: 00000100:00100000:3.0:1788305414.750476:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb889a0b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122560:12345-0@lo:503: Request processed in 1352us (2192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.750492:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788305414.752421:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007a04f14b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122560:0@lo:503: 00000100:00100000:1.0:1788305414.753973:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7992:1875174015122688:0@lo:502: 00000100:00100000:1.0:1788305414.754088:0:7992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305414.754215:0:7992:0:(client.c:2715:ptlrpc_set_wait()) set 00000000543909f6 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.754484:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122688 00000100:00100000:3.0:1788305414.754496:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122688 00000100:00100000:3.0:1788305414.754602:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305414.754615:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039dc7b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7992:x1875174015122688:12345-0@lo:502: 00000100:00100000:3.0:1788305414.755081:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039dc7b81 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:7992:x1875174015122688:12345-0@lo:502: Request processed in 466us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.755091:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788305414.755220:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f8f085f pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7992:1875174015122688:0@lo:502: 00000020:01000000:1.0:1788305414.755263:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305414.755294:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305414.755306:0:7992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788305414.755316:0:7992:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891894cd800 00000020:00000080:1.0:1788305414.755318:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305414.755381:0:7992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7992:1875174015122816:0@lo:502: 00000100:00100000:1.0:1788305414.755422:0:7992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305414.755666:0:7992:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788305414.756036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122816 00000100:00100000:0.0:1788305414.756045:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122816 00000100:00100000:0.0:1788305414.756106:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305414.756116:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:7992:x1875174015122816:12345-0@lo:502: 00000100:00100000:0.0:1788305414.756260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:7992:x1875174015122816:12345-0@lo:502: Request processed in 145us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305414.756269:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788305414.756481:0:7992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7992:1875174015122816:0@lo:502: 00000020:01000000:1.0:1788305414.756510:0:7992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305414.756518:0:7992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305414.756520:0:7992:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788305414.756525:0:7992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788305414.757972:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788305414.758015:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305414.758032:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758048:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305414.758063:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305414.758067:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a3800 from 1 10000000:01000000:0.0:1788305414.758071:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305414.758121:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758131:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758165:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305414.758196:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122944:0@lo:101: 00000100:00100000:0.0:1788305414.758370:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305414.758427:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305414.758455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015122944 00000100:00100000:0.0:1788305414.758462:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015122944 00000100:00100000:0.0:1788305414.758509:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305414.758519:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015122944:12345-0@lo:101: 00010000:00010000:0.0:1788305414.758537:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305414.758552:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053218 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758580:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053218 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758594:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053218 expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.758606:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b000, rc 0) 00000100:00100000:0.0:1788305414.758787:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015122944:12345-0@lo:101: Request processed in 267us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305414.758794:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305414.758851:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015122944:0@lo:101: 00010000:00010000:0.0:1788305414.759138:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305414.759165:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305414.759342:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015123072:0@lo:501: 00000100:00100000:0.0:1788305414.759377:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305414.759473:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.759521:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123072 00000100:00100000:3.0:1788305414.759527:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123072 00000100:00100000:3.0:1788305414.759605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788305414.759614:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015123072:12345-0@lo:501: 00000100:00100000:3.0:1788305414.760085:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015123072:12345-0@lo:501: Request processed in 472us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.760105:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788305414.760439:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015123072:0@lo:501: 00000100:00100000:1.0:1788305414.760485:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015123200:0@lo:503: 00000100:00100000:1.0:1788305414.760626:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305414.761008:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.761053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123200 00000100:00100000:3.0:1788305414.761059:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123200 00000100:00100000:3.0:1788305414.761158:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305414.761178:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015123200:12345-0@lo:503: 00000100:00100000:3.0:1788305414.761377:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015123200:12345-0@lo:503: Request processed in 210us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.761385:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788305414.761661:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015123200:0@lo:503: 00000100:00100000:1.0:1788305414.761969:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7993:1875174015123328:0@lo:502: 00000100:00100000:1.0:1788305414.762014:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305414.762539:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305414.763043:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123328 00000100:00100000:0.0:1788305414.763053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123328 00000100:00100000:0.0:1788305414.763105:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305414.763115:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:7993:x1875174015123328:12345-0@lo:502: 00000100:00100000:1.0:1788305414.763819:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:7993:x1875174015123328:12345-0@lo:502: Request processed in 700us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305414.763830:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305414.770483:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7993:1875174015123328:0@lo:502: 00000020:01000000:0.0:1788305414.770545:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305414.770559:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305414.770561:0:7993:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788305414.770568:0:7993:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88918c9a3800 00000020:00000080:0.0:1788305414.770571:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788305414.770623:0:7993:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7993:1875174015123456:0@lo:502: 00000100:00100000:0.0:1788305414.771020:0:7993:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305414.771088:0:7993:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305414.771219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123456 00000100:00100000:3.0:1788305414.771229:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123456 00000100:00100000:3.0:1788305414.771335:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788305414.771346:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:7993:x1875174015123456:12345-0@lo:502: 00000100:00100000:3.0:1788305414.771526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:7993:x1875174015123456:12345-0@lo:502: Request processed in 181us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305414.771534:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305414.771837:0:7993:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:7993:1875174015123456:0@lo:502: 00000020:01000000:1.0:1788305414.771882:0:7993:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305414.771891:0:7993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305414.771893:0:7993:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788305414.771898:0:7993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788305414.772169:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788305414.772214:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305414.772229:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305414.772243:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305415.257549:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305416.277714:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305417.302011:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305417.685675:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015123584:0@lo:41: 00000100:00100000:1.0:1788305417.685752:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015123712:0@lo:400: 00000100:00100000:2.0:1788305417.685761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305417.688786:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305417.688866:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305417.688878:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015123840:0@lo:400: 00000100:00100000:1.0:1788305417.688941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305417.688985:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123712 00000100:00100000:1.0:1788305417.688992:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123712 00000100:00100000:1.0:1788305417.689040:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305417.689049:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:3647:x1875174015123712:12345-0@lo:400: 00000100:00100000:1.0:1788305417.689114:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:3647:x1875174015123712:12345-0@lo:400: Request processed in 66us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305417.689122:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305417.689153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123840 00000100:00100000:1.0:1788305417.689157:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123840 00000100:00100000:1.0:1788305417.689183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305417.689190:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015123840:12345-0@lo:400: 00000100:00100000:1.0:1788305417.689221:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015123840:12345-0@lo:400: Request processed in 31us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305417.689227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788305417.689264:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e00000 x1875174015123840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305417.689295:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015123840:0@lo:400: 00000100:00100000:1.0:1788305417.689307:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015123712:0@lo:400: 00000100:00100000:2.0:1788305417.695523:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015124096:0@lo:41: 00000100:00100000:2.0:1788305417.695605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305417.695658:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305417.695665:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015123968:0@lo:400: 00000100:00100000:2.0:1788305417.695688:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305417.695738:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123584 00000100:00100000:2.0:1788305417.695747:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123584 00000100:00100000:2.0:1788305417.695785:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124096 00000100:00100000:2.0:1788305417.695788:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124096 00000100:00100000:2.0:1788305417.695798:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015123968 00000100:00100000:2.0:1788305417.695800:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015123968 00000100:00100000:2.0:1788305417.695812:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305417.695820:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015123584:12345-0@lo:41: 00000004:00000024:2.0:1788305417.695865:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788305417.695916:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015123584:12345-0@lo:41: Request processed in 96us (10156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305417.695924:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305417.695939:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305417.695956:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015124096:12345-0@lo:41: 00000004:00000024:2.0:1788305417.695973:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788305417.695998:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015124096:12345-0@lo:41: Request processed in 43us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305417.696004:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305417.696015:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305417.696020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015123968:12345-0@lo:400: 00000100:00100000:2.0:1788305417.696045:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015123968:12345-0@lo:400: Request processed in 25us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305417.696051:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305417.696081:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015123968:0@lo:400: 00000100:00100000:2.0:1788305417.696093:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015124096:0@lo:41: 00000100:00100000:2.0:1788305417.696104:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015123584:0@lo:41: 00000100:00100000:0.0:1788305417.700795:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305417.700820:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015124224:0@lo:400: 00000100:00100000:0.0:1788305417.700898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305417.701066:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124224 00000100:00100000:1.0:1788305417.701075:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124224 00000100:00100000:1.0:1788305417.701189:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305417.701211:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015124224:12345-0@lo:400: 00000100:00100000:1.0:1788305417.701305:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015124224:12345-0@lo:400: Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305417.701313:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788305417.701401:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e03100 x1875174015124224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305417.701415:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015124224:0@lo:400: 00010000:00010000:2.0:1788305418.329252:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305419.349999:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305420.373524:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305421.399168:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305422.423495:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305422.811015:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015124352:0@lo:41: 00000100:00100000:3.0:1788305422.811087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305422.811484:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124352 00000100:00100000:2.0:1788305422.811493:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124352 00000100:00100000:2.0:1788305422.811540:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305422.811550:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015124352:12345-0@lo:41: 00000004:00000024:2.0:1788305422.811583:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788305422.811808:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015124480:0@lo:41: 00000100:00100000:0.0:1788305422.811893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305422.811925:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305422.811932:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015124608:0@lo:400: 00000100:00100000:0.0:1788305422.811974:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305422.812004:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124608 00000100:00100000:0.0:1788305422.812008:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124608 00000100:00100000:0.0:1788305422.812034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305422.812040:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:3649:x1875174015124608:12345-0@lo:400: 00000100:00100000:0.0:1788305422.812074:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:3649:x1875174015124608:12345-0@lo:400: Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305422.812081:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305422.812120:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015124608:0@lo:400: 00000100:00100000:2.0:1788305422.812751:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015124352:12345-0@lo:41: Request processed in 1199us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305422.812759:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305422.812775:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124480 00000100:00100000:2.0:1788305422.812778:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124480 00000100:00100000:2.0:1788305422.812817:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305422.812840:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015124480:12345-0@lo:41: 00000004:00000024:2.0:1788305422.812863:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1788305422.812907:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015124480:12345-0@lo:41: Request processed in 68us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305422.812912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305422.812950:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015124480:0@lo:41: 00000100:00100000:3.0:1788305422.815059:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015124736:0@lo:400: 00000100:00100000:3.0:1788305422.815125:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305422.815187:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305422.815193:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015124864:0@lo:400: 00000100:00100000:3.0:1788305422.815219:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305422.815250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124736 00000100:00100000:3.0:1788305422.815256:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124736 00000100:00100000:3.0:1788305422.815343:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124864 00000100:00100000:3.0:1788305422.815346:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124864 00000100:00100000:3.0:1788305422.815364:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305422.815371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015124736:12345-0@lo:400: 00000100:00100000:3.0:1788305422.815421:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015124736:12345-0@lo:400: Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305422.815428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305422.815445:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305422.815451:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015124864:12345-0@lo:400: 00000100:00100000:3.0:1788305422.815479:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015124864:12345-0@lo:400: Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305422.815485:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788305422.815519:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8d45f80 x1875174015124864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305422.815533:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015124864:0@lo:400: 00010000:00080000:3.0:1788305422.815545:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8d45500 x1875174015124736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305422.815553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015124736:0@lo:400: 00000100:00100000:1.0:1788305422.821201:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015124352:0@lo:41: 00000020:01000004:0.0:1788305423.407180:0:8429:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788305423.407185:0:8429:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788305423.407187:0:8429:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788305423.414770:0:8429:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8891b9152800 00000020:01000004:3.0:1788305423.414804:0:8429:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788305423.414818:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788305423.414845:0:8429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8891b8fa0000) 00000020:00000080:3.0:1788305423.414867:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788305423.446591:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788305423.494503:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788305423.494767:0:8429:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788305423.560458:0:8429:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788305423.560700:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788305423.560715:0:8429:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788305423.560730:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e605322d 00000020:01000004:2.0:1788305423.560737:0:8429:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788305423.560760:0:8429:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788305423.560764:0:8429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788305423.560771:0:8429:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788305423.560776:0:8429:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788305423.560808:0:8429:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8891bb4f19b8) 00000020:00000080:2.0:1788305423.560821:0:8429:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788305423.562247:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305423.562432:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788305423.562439:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788305423.563461:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305423.563469:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788305423.563907:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788305423.563913:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788305423.567243:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305423.571431:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788305423.571439:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788305423.572120:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305423.572129:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788305423.602720:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305423.603022:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788305423.603029:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788305423.605558:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305423.605571:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788305423.608652:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305423.608665:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788305423.617441:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305423.617702:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788305423.617708:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788305423.618898:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305423.618907:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788305423.680730:0:8429:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305423.681908:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788305423.682467:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788305423.692587:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305423.692609:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788305423.705622:0:8429:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788305423.705664:0:8429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788305423.705671:0:8429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788305423.748121:0:8429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788305423.748164:0:8429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788305423.748241:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788305423.748243:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788305423.748244:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305423.748245:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305423.748246:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305423.748248:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305423.748249:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305423.748257:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788305423.748258:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788305423.748259:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305423.748261:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305423.748709:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788305423.748712:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305423.748713:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788305423.748714:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305423.748715:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305423.748716:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305423.748718:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305423.748719:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305423.748720:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788305423.748720:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788305423.748721:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305423.748722:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305423.750625:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788305423.750654:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015124992:0@lo:253: 00000100:00100000:3.0:1788305423.750736:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.750984:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305423.751121:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015124992 00000100:00100000:1.0:1788305423.751129:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015124992 00000100:00100000:1.0:1788305423.751309:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305423.751320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:8429:x1875174015124992:12345-0@lo:253: 20000000:01000000:1.0:1788305423.751353:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788305423.751358:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788305423.751362:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788305423.751366:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788305423.751971:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305423.752443:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788305423.752461:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788305423.752479:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788305423.752485:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788305423.752498:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788305423.752513:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788305423.752984:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788305423.753000:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:1.0:1788305423.753002:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788305423.753016:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788305423.753113:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788305423.753135:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788305423.753141:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:1.0:1788305423.753156:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788305423.753163:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788305423.753190:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788305423.753207:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788305423.754015:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788305423.754889:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:1.0:1788305423.754892:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788305423.754943:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788305423.754951:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788305423.754966:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788305423.754971:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:1.0:1788305423.755251:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788305423.755637:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788305423.755661:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788305423.755680:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788305423.756699:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788305423.757113:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:1.0:1788305423.757115:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:1.0:1788305423.757136:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788305423.757145:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788305423.757159:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788305423.757164:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:1.0:1788305423.757259:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788305423.757677:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788305423.757697:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788305423.757714:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788305423.757731:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788305423.757747:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788305423.757751:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788305423.757807:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788305423.757810:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305423.758694:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305423.758857:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305423.758877:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788305423.759145:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788305423.759166:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788305423.759255:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788305423.759544:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788305423.759610:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305423.759914:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305423.759934:0:8449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305423.759949:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788305423.760240:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788305423.760909:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788305423.760947:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788305423.760959:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788305423.760962:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788305423.761795:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788305423.761983:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788305423.762004:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788305423.762017:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788305423.762099:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788305423.762102:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305423.763120:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305423.763156:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305423.763257:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788305423.765883:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788305423.765917:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788305423.765936:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788305423.765953:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788305423.765972:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.765990:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.765999:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053177 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766006:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531af expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766482:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766489:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766497:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766537:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766673:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.766689:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125120:0@lo:104: 00000100:00100000:1.0:1788305423.766757:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305423.766823:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766831:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.766839:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125248:0@lo:104: 00000100:00100000:1.0:1788305423.766860:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305423.766884:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60531af expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766892:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60531af expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.766909:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125376:0@lo:104: 00000100:00100000:1.0:1788305423.766944:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305423.766964:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.766973:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.766981:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125504:0@lo:104: 00000100:00100000:1.0:1788305423.767000:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305423.767016:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.767099:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.767109:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125632:0@lo:104: 00000100:00100000:1.0:1788305423.767131:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305423.767141:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.767304:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125120 00000100:00100000:2.0:1788305423.767312:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125120 00000100:00100000:2.0:1788305423.767347:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125248 00000100:00100000:2.0:1788305423.767350:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125248 00000100:00100000:2.0:1788305423.767360:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125376 00000100:00100000:2.0:1788305423.767362:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125376 00000100:00100000:2.0:1788305423.767391:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125504 00000100:00100000:2.0:1788305423.767394:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125504 00000100:00100000:2.0:1788305423.767403:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125632 00000100:00100000:2.0:1788305423.767404:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125632 00000100:00100000:2.0:1788305423.767416:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305423.767424:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+7:6514:x1875174015125120:12345-0@lo:104: 00010000:00010000:2.0:1788305423.767435:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.767500:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305423.767507:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+7:6514:x1875174015125120:12345-0@lo:104: Request processed in 84us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.767514:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788305423.767529:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305423.767535:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:6514:x1875174015125248:12345-0@lo:104: 00010000:00010000:2.0:1788305423.767543:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.767827:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125120:0@lo:104: 00010000:00010000:2.0:1788305423.767906:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305423.767911:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:6514:x1875174015125248:12345-0@lo:104: Request processed in 376us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.767917:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305423.767930:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305423.767936:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:6514:x1875174015125376:12345-0@lo:104: 00010000:00010000:2.0:1788305423.767942:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.767977:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788305423.767988:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:6514:x1875174015125376:12345-0@lo:104: Request processed in 52us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.767993:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305423.768005:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305423.768010:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015125504:12345-0@lo:104: 00010000:00010000:2.0:1788305423.768017:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768057:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788305423.768062:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015125504:12345-0@lo:104: Request processed in 53us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.768069:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788305423.768080:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305423.768085:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015125632:12345-0@lo:104: 00010000:00010000:2.0:1788305423.768092:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768118:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788305423.768122:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015125632:12345-0@lo:104: Request processed in 38us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.768128:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788305423.768144:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788305423.768149:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768156:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.768160:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768191:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.768197:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.768204:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.768235:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768242:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.768258:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768293:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a600/0x4a426866e60531f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531fc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768308:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788305423.768311:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768316:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181666000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.768319:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768326:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.768333:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.768345:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.768359:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768365:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.768371:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768386:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181666000/0x4a426866e60531cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531d2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768396:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788305423.768399:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768403:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181667a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.768406:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768412:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.768417:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.768423:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.768435:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768441:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.768464:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768470:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181667a00/0x4a426866e60531af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531b6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768492:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305423.768495:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768501:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.768503:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768509:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.768515:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.768520:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.768533:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.768538:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.768543:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.768992:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125248:0@lo:104: 00000100:00100000:1.0:1788305423.769002:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125376:0@lo:104: 00000100:00100000:1.0:1788305423.769010:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125504:0@lo:104: 00000100:00100000:1.0:1788305423.769075:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015125632:0@lo:104: 00010000:00010000:1.0:1788305423.769101:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769162:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519400/0x4a426866e6053177 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605317e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769225:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305423.769234:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769241:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.769244:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769251:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.769258:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.769536:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.769626:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769634:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.769640:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769646:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181682c00/0x4a426866e6053100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053107 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.769659:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.769661:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.769663:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.769671:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.769676:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305423.769696:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015125760:0@lo:103: 00000100:00100000:2.0:1788305423.769745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.769877:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015126272:0@lo:103: 00000100:00100000:2.0:1788305423.769900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.770261:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305423.770413:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015125888:0@lo:103: 00000100:00100000:2.0:1788305423.770439:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.770471:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125760 00000100:00100000:3.0:1788305423.770487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125760 00010000:00010000:3.0:1788305423.770518:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 19 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.770761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126272 00000100:00100000:3.0:1788305423.770766:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126272 00010000:00010000:3.0:1788305423.770782:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 20 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.770813:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305423.770823:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015125760:12345-0@lo:103: 00010000:00010000:3.0:1788305423.770836:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305423.770841:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770853:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770868:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519800/0x4a426866e60531fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60531f5 expref: 20 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770882:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305423.770916:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+19:3649:x1875174015125760:12345-0@lo:103: Request processed in 94us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.770922:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305423.770939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305423.770945:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+18:3649:x1875174015126272:12345-0@lo:103: 00010000:00010000:3.0:1788305423.770952:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305423.770957:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770965:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770983:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683000/0x4a426866e6053107 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053100 expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.770993:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305423.771017:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015126272:12345-0@lo:103: Request processed in 72us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.771036:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305423.771373:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015126144:0@lo:103: 00000100:00100000:0.0:1788305423.771686:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015126016:0@lo:103: 00000100:00100000:2.0:1788305423.772158:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015125760:0@lo:103: 00000100:00100000:2.0:1788305423.772179:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015126272:0@lo:103: 00000100:00100000:1.0:1788305423.772305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.772843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.772908:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015125888 00000100:00100000:3.0:1788305423.772915:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015125888 00010000:00010000:3.0:1788305423.772943:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 17 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.772972:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126144 00000100:00100000:3.0:1788305423.772975:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126144 00010000:00010000:3.0:1788305423.772987:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 18 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.773008:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305423.773016:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+18:3649:x1875174015125888:12345-0@lo:103: 00010000:00010000:3.0:1788305423.773037:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305423.773043:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773054:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773069:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181667c00/0x4a426866e60531d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60531cb expref: 18 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773095:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305423.773152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3649:x1875174015125888:12345-0@lo:103: Request processed in 136us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.773158:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305423.773185:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305423.773192:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+16:3648:x1875174015126144:12345-0@lo:103: 00010000:00010000:3.0:1788305423.773200:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305423.773204:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 16 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773213:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 16 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773223:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523ae00/0x4a426866e605317e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053177 expref: 16 pid: 6514 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.773232:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305423.773260:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+15:3648:x1875174015126144:12345-0@lo:103: Request processed in 69us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.773301:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305423.773332:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015126144:0@lo:103: 00000100:00100000:2.0:1788305423.774346:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015125888:0@lo:103: 00000100:00100000:1.0:1788305423.774517:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126016 00000100:00100000:1.0:1788305423.774524:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126016 00010000:00010000:1.0:1788305423.774558:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305423.774589:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305423.774597:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+15:3647:x1875174015126016:12345-0@lo:103: 00010000:00010000:1.0:1788305423.774606:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305423.774611:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774622:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774636:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519a00/0x4a426866e60531b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60531af expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774651:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774659:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774675:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774682:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774703:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774710:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774716:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181666200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305423.774721:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774729:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774745:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774757:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305423.774807:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+14:3647:x1875174015126016:12345-0@lo:103: Request processed in 211us (1965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305423.774815:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788305423.774861:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774869:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.774875:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666200/0x4a426866e605323b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305423.774888:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788305423.776323:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015126016:0@lo:103: 00000100:00100000:2.0:1788305423.780128:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+13:8429:x1875174015124992:12345-0@lo:253: Request processed in 28801us (29382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.780142:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788305423.780484:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015124992:0@lo:253: 10000000:01000000:3.0:1788305423.780501:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788305423.780504:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305423.780506:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788305423.780507:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305423.780509:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788305423.780523:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305423.780524:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305423.780526:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305423.780527:0:8429:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788305423.780529:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305423.780530:0:8429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788305423.780673:0:8429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8891b9152800 from lustre-OST0000 10000000:01000000:3.0:1788305423.780703:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788305423.780706:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788305423.780714:0:8429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889186788000 local copy 10000000:01000000:3.0:1788305423.780719:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788305423.780753:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.780765:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.780775:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.780861:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126400:0@lo:101: 00000100:00100000:3.0:1788305423.780901:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.780969:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305423.781006:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126400 00000100:00100000:1.0:1788305423.781013:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126400 00000100:00100000:1.0:1788305423.781164:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788305423.781186:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+13:8429:x1875174015126400:12345-0@lo:101: 00010000:00010000:1.0:1788305423.781200:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305423.781215:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181667400/0x4a426866e6053249 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053242 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.781237:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181667400/0x4a426866e6053249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053242 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.781248:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181667400/0x4a426866e6053249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053242 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.781258:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181667400, rc 0) 00000100:00100000:1.0:1788305423.781330:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015126400:12345-0@lo:101: Request processed in 147us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305423.781337:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788305423.781415:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126400:0@lo:101: 00010000:00010000:3.0:1788305423.781428:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.781437:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.781521:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126528:0@lo:501: 00000100:00100000:3.0:1788305423.781558:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.782193:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.782322:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126528 00000100:00100000:0.0:1788305423.782328:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126528 00000100:00100000:2.0:1788305423.782648:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788305423.782659:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015126528:12345-0@lo:501: 00000100:00100000:2.0:1788305423.782739:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015126528:12345-0@lo:501: Request processed in 82us (1191us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305423.782746:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788305423.783109:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126528:0@lo:501: 10000000:01000000:3.0:1788305423.783127:0:8429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788305423.783148:0:8429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788305423.783154:0:8429:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.783164:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.783241:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.783491:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788305423.783518:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8891b9152800 10000000:01000000:3.0:1788305423.783523:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788305423.783529:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788305423.783531:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305423.783536:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788305423.783539:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788305423.783574:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.783583:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.783591:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.783608:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126656:0@lo:101: 00000100:00100000:3.0:1788305423.783653:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.783683:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305423.784409:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126656 00000100:00100000:1.0:1788305423.784417:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126656 00000100:00100000:1.0:1788305423.784465:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788305423.784474:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015126656:12345-0@lo:101: 00010000:00010000:1.0:1788305423.784486:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305423.784499:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053250 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.784523:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053250 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.784534:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053250 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.784563:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181666600, rc 0) 00000100:00100000:1.0:1788305423.784614:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015126656:12345-0@lo:101: Request processed in 140us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305423.784620:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1788305423.784960:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305423.784968:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.784976:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.784980:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.785000:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.785008:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.785014:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.785113:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.785120:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788305423.785164:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015126784:0@lo:103: 00000100:00100000:1.0:1788305423.785359:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305423.785530:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.785538:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e6053249 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.785565:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.785567:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.785568:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305423.785724:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126656:0@lo:101: 00010000:00010000:3.0:1788305423.785741:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.785751:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305423.785923:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126912:0@lo:501: 00000100:00100000:3.0:1788305423.785953:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.785975:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de300 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.786017:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126784 00000100:00100000:0.0:1788305423.786029:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126784 00000100:00100000:0.0:1788305423.786075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305423.786083:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+15:3650:x1875174015126784:12345-0@lo:103: 00010000:00010000:0.0:1788305423.786093:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305423.786106:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181667400/0x4a426866e6053249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053242 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.786130:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305423.786370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015126912 00000100:00100000:2.0:1788305423.786375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015126912 00000100:00100000:2.0:1788305423.786529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305423.786537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015126912:12345-0@lo:501: 00000100:00100000:2.0:1788305423.786647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015126912:12345-0@lo:501: Request processed in 110us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.786655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788305423.786774:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015126912:0@lo:501: 00000100:00100000:3.0:1788305423.786821:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127040:0@lo:503: 00000100:00100000:3.0:1788305423.786863:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.786893:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305423.786909:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127040 00000100:00100000:3.0:1788305423.786912:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127040 00000100:00100000:3.0:1788305423.786935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788305423.786941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127040:12345-0@lo:503: 00000100:00100000:3.0:1788305423.787031:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127040:12345-0@lo:503: Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.787038:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788305423.787083:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127040:0@lo:503: 00000040:00080000:3.0:1788305423.787352:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305423.787818:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127168:0@lo:502: 00000100:00100000:3.0:1788305423.787864:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.787896:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.787983:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127168 00000100:00100000:2.0:1788305423.787988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127168 00000100:00100000:2.0:1788305423.788036:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305423.788044:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127168:12345-0@lo:502: 00000100:00100000:2.0:1788305423.788124:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127168:12345-0@lo:502: Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.788131:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788305423.788322:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127168:0@lo:502: 00000040:00080000:3.0:1788305423.788718:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788305423.788747:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788305423.788760:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788305423.788916:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788305423.788937:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788305423.788951:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788305423.788972:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127296:0@lo:502: 00000100:00100000:3.0:1788305423.789010:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.789137:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.789493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127296 00000100:00100000:2.0:1788305423.789498:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127296 00000100:00100000:2.0:1788305423.789535:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305423.789544:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127296:12345-0@lo:502: 00000100:00100000:0.0:1788305423.789699:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+15:3650:x1875174015126784:12345-0@lo:103: Request processed in 3615us (4339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.789709:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305423.789962:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015127296:12345-0@lo:502: Request processed in 419us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.789970:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788305423.790057:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127296:0@lo:502: 00000040:00080000:3.0:1788305423.790115:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788305423.790125:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788305423.791249:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305423.791259:0:8452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788305423.791518:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305423.791522:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788305423.791531:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305423.791546:0:8452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8891bb4f3370) 00000020:00000080:2.0:1788305423.791579:0:8452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305423.791586:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305423.791677:0:8452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891b9152800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788305423.791686:0:8452:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305423.791702:0:8452:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e6053265 00000100:00100000:1.0:1788305423.795856:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015126784:0@lo:103: 00010000:00010000:2.0:1788305423.799942:0:8452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788305423.800665:0:8452:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788305423.805657:0:8452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788305423.806579:0:8452:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788305423.814763:0:8452:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788305423.815056:0:8452:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:3.0:1788305423.830000:0:8452:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788305423.832214:0:8452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788305423.832227:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305423.832234:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305423.832236:0:8452:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788305423.832240:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305423.832245:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305423.832247:0:8452:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305423.832250:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305423.832252:0:8452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305423.832309:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305423.832313:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305423.832315:0:8452:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788305423.832324:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788305423.832678:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788305423.832712:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788305423.832734:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.832747:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305423.832756:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891b9152800 from 1 10000000:01000000:0.0:1788305423.832759:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305423.832810:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.832819:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.832831:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.832856:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127424:0@lo:101: 00000100:00100000:0.0:1788305423.832926:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.832973:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.833101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127424 00000100:00100000:2.0:1788305423.833111:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127424 00000100:00100000:2.0:1788305423.833163:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305423.833181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:8429:x1875174015127424:12345-0@lo:101: 00010000:00010000:2.0:1788305423.833194:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305423.833207:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605326c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.833230:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605326c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.833241:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605326c expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.833250:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682c00, rc 0) 00000100:00100000:2.0:1788305423.833317:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127424:12345-0@lo:101: Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.833324:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788305423.833688:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127424:0@lo:101: 00010000:00010000:0.0:1788305423.833703:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.833719:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.833813:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127552:0@lo:501: 00000100:00100000:0.0:1788305423.833840:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.833873:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.833973:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127552 00000100:00100000:2.0:1788305423.833978:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127552 00000100:00100000:2.0:1788305423.834009:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788305423.834016:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127552:12345-0@lo:501: 00000100:00100000:2.0:1788305423.834104:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127552:12345-0@lo:501: Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.834112:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788305423.835505:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127552:0@lo:501: 00000100:00100000:0.0:1788305423.835561:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127680:0@lo:503: 00000100:00100000:0.0:1788305423.835626:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.835665:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.835769:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127680 00000100:00100000:2.0:1788305423.835775:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127680 00000100:00100000:2.0:1788305423.835829:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788305423.835839:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127680:12345-0@lo:503: 00000100:00100000:2.0:1788305423.835942:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127680:12345-0@lo:503: Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.835960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305423.836094:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127680:0@lo:503: 00000040:00080000:0.0:1788305423.836776:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305423.836994:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127808:0@lo:502: 00000100:00100000:0.0:1788305423.837052:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.837076:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305423.837147:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127808 00000100:00100000:2.0:1788305423.837152:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127808 00000100:00100000:2.0:1788305423.837194:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305423.837203:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127808:12345-0@lo:502: 00000100:00100000:2.0:1788305423.837328:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127808:12345-0@lo:502: Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.837336:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788305423.837538:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127808:0@lo:502: 00000040:00080000:3.0:1788305423.837740:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788305423.837767:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788305423.837928:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127936:0@lo:502: 00000100:00100000:3.0:1788305423.837968:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.837994:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305423.838010:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015127936 00000100:00100000:3.0:1788305423.838014:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015127936 00000100:00100000:3.0:1788305423.838036:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788305423.838042:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127936:12345-0@lo:502: 00000100:00100000:3.0:1788305423.838109:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015127936:12345-0@lo:502: Request processed in 66us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.838115:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788305423.838155:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015127936:0@lo:502: 00000040:00080000:3.0:1788305423.838188:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788305423.838195:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788305423.841801:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305423.841814:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305423.841816:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305423.841824:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891b9152800 00000020:00000080:3.0:1788305423.841827:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305423.841840:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305423.841843:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305423.841845:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788305423.841848:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788305423.842061:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788305423.842093:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305423.842117:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842130:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305423.842179:0:8429:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788305423.842182:0:8429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8891b9152800 10000000:01000000:0.0:1788305423.842185:0:8429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8891b9152800 10000000:01000000:0.0:1788305423.842197:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305423.842203:0:8429:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891b9152800 from 1 10000000:01000000:0.0:1788305423.842206:0:8429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305423.842240:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842249:0:8429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842259:0:8429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.842311:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128064:0@lo:101: 00000100:00100000:0.0:1788305423.842390:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.842436:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.842459:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128064 00000100:00100000:0.0:1788305423.842466:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128064 00000100:00100000:0.0:1788305423.842510:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305423.842520:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8429:x1875174015128064:12345-0@lo:101: 00010000:00010000:0.0:1788305423.842533:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305423.842545:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605327a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842578:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605327a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842590:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605327a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842599:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b400, rc 0) 00000100:00100000:0.0:1788305423.842646:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128064:12345-0@lo:101: Request processed in 126us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.842664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305423.842711:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128064:0@lo:101: 00010000:00010000:0.0:1788305423.842726:0:8429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.842735:0:8429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.842834:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128192:0@lo:501: 00000100:00100000:0.0:1788305423.842862:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.842877:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.842892:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128192 00000100:00100000:0.0:1788305423.842896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128192 00000100:00100000:0.0:1788305423.842919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305423.842926:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128192:12345-0@lo:501: 00000100:00100000:0.0:1788305423.843019:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128192:12345-0@lo:501: Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.843026:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305423.843058:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128192:0@lo:501: 00000100:00100000:0.0:1788305423.843082:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128320:0@lo:503: 00000100:00100000:0.0:1788305423.843119:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.843132:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.843145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128320 00000100:00100000:0.0:1788305423.843148:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128320 00000100:00100000:0.0:1788305423.843169:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305423.843181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128320:12345-0@lo:503: 00000100:00100000:0.0:1788305423.843256:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128320:12345-0@lo:503: Request processed in 74us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.843263:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305423.843327:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128320:0@lo:503: 00000040:00080000:0.0:1788305423.843555:0:8429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305423.843610:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128448:0@lo:502: 00000100:00100000:0.0:1788305423.843644:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.843657:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.843670:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128448 00000100:00100000:0.0:1788305423.843674:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128448 00000100:00100000:0.0:1788305423.843695:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305423.843701:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128448:12345-0@lo:502: 00000100:00100000:0.0:1788305423.843775:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128448:12345-0@lo:502: Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.843781:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305423.843832:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128448:0@lo:502: 00000040:00080000:0.0:1788305423.844008:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788305423.844033:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788305423.844048:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788305423.844061:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788305423.844088:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788305423.844101:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788305423.844113:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788305423.844126:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788305423.844139:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788305423.844152:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788305423.844172:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788305423.844185:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788305423.844198:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788305423.844211:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788305423.844223:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788305423.844236:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788305423.844248:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788305423.844260:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788305423.844292:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788305423.844307:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788305423.844330:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788305423.844345:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788305423.844358:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788305423.844370:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788305423.844383:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788305423.844395:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788305423.844406:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788305423.844419:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788305423.844431:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788305423.844445:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788305423.844458:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788305423.844471:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788305423.844484:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788305423.844495:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788305423.844506:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788305423.844517:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788305423.844539:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788305423.844563:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128576:0@lo:502: 00000100:00100000:0.0:1788305423.844603:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.844634:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128576 00000100:00100000:0.0:1788305423.844639:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128576 00000100:00100000:0.0:1788305423.844665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305423.844677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128576:12345-0@lo:502: 00000100:00100000:0.0:1788305423.844743:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015128576:12345-0@lo:502: Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305423.844749:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305423.844814:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.844830:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015128576:0@lo:502: 00000040:00080000:0.0:1788305423.844866:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788305423.844873:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788305423.859016:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788305423.859244:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff889186223370) 00000020:00000080:0.0:1788305423.859662:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788305423.859768:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891b9152800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305423.859773:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891b9152800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305423.859775:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891b9152800 3 00010000:00080000:0.0:1788305423.859825:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891badee000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305423.864849:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788305423.865124:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788305423.865170:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788305423.865184:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4a426866e605328f 00000100:00080000:0.0:1788305423.865195:0:8457:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305423.865201:0:8457:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8891badee000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305423.865235:0:8457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00e00 x1875174015128704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305423.865270:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305423.865479:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015128704:0@lo:38: 00000100:00100000:3.0:1788305423.865564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.865636:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015128960:0@lo:400: 00000100:00100000:3.0:1788305423.865666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.865687:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305423.865693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015128832:0@lo:400: 00000100:00100000:3.0:1788305423.865715:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.865745:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128704 00000100:00100000:3.0:1788305423.865752:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128704 00000100:00100000:3.0:1788305423.865778:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128832 00000100:00100000:3.0:1788305423.865780:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128832 00000100:00100000:3.0:1788305423.865817:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305423.865825:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015128832:12345-0@lo:400: 00000100:00100000:3.0:1788305423.865872:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015128832:12345-0@lo:400: Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.865880:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305423.865894:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305423.865899:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015128704:12345-0@lo:38: 00010000:00080000:3.0:1788305423.865919:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:3.0:1788305423.865945:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4a426866e6053296 00000004:00100000:3.0:1788305423.865959:0:6520:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788305423.865987:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8891b8f77800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305423.866025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875174015128704:12345-0@lo:38: Request processed in 125us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.866031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305423.866051:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015128960 00000100:00100000:3.0:1788305423.866054:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015128960 00000100:00100000:3.0:1788305423.866076:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305423.866082:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015128960:12345-0@lo:400: 00000100:00100000:3.0:1788305423.866124:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015128960:12345-0@lo:400: Request processed in 41us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.866130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788305423.866170:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e00a80 x1875174015128832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305423.866183:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015128832:0@lo:400: 00000100:00100000:3.0:1788305423.866195:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015128960:0@lo:400: 00010000:00080000:3.0:1788305423.866221:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e00e00 x1875174015128704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305423.866229:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305423.866235:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788305423.866242:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788305423.866246:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305423.866248:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305423.866253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015128704:0@lo:38: 00000100:00100000:0.0:1788305423.866473:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015129216:0@lo:400: 00000100:00100000:0.0:1788305423.866503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305423.866535:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305423.866678:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015129088:0@lo:400: 00000100:00100000:0.0:1788305423.866705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.866863:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129216 00000100:00100000:3.0:1788305423.866868:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129216 00000100:00100000:3.0:1788305423.866899:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305423.866905:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015129216:12345-0@lo:400: 00000100:00100000:3.0:1788305423.866942:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015129216:12345-0@lo:400: Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.866947:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305423.866970:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015129216:0@lo:400: 00000100:00100000:3.0:1788305423.866983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129088 00000100:00100000:3.0:1788305423.866991:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129088 00000100:00100000:3.0:1788305423.867025:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788305423.867032:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015129088:12345-0@lo:400: 00000100:00100000:3.0:1788305423.867066:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015129088:12345-0@lo:400: Request processed in 35us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.867072:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788305423.867097:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e02680 x1875174015129088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305423.867105:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015129088:0@lo:400: 00000020:01000004:0.0:1788305423.867979:0:8457:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788305423.867996:0:8457:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff889186220000) 00000020:00000080:0.0:1788305423.868027:0:8457:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788305423.868119:0:8457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891b9152800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305423.868123:0:8457:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891b9152800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788305423.868126:0:8457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891b9152800 3 00010000:00080000:0.0:1788305423.868155:0:8457:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891894c8800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305423.872837:0:8457:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788305423.873033:0:8457:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788305423.873089:0:8457:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788305423.873102:0:8457:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4a426866e60532a4 00000100:00080000:0.0:1788305423.873113:0:8457:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305423.873118:0:8457:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8891894c8800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305423.873154:0:8457:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00000 x1875174015129344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305423.873184:0:8457:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788305423.873308:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015129344:0@lo:38: 00000100:00100000:2.0:1788305423.873389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.873450:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129344 00000100:00100000:2.0:1788305423.873457:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129344 00000100:00100000:2.0:1788305423.873488:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305423.873496:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015129344:12345-0@lo:38: 00010000:00080000:2.0:1788305423.873518:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:2.0:1788305423.873672:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4a426866e60532ab 00000004:00100000:2.0:1788305423.873689:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788305423.873718:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8890820bb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305423.873763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875174015129344:12345-0@lo:38: Request processed in 267us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.873770:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788305423.873826:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e00000 x1875174015129344/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305423.873836:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305423.873843:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788305423.873849:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788305423.873861:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788305423.873863:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305423.873869:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015129344:0@lo:38: 00000040:00080000:2.0:1788305423.884211:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788305423.884402:0:8429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788305423.884435:0:8429:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305423.884458:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305423.884470:0:8429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305423.884532:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305423.884534:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305423.884536:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305423.884537:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305423.884538:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305423.884540:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305423.884542:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305423.884543:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305423.884556:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305423.884558:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305423.884559:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305423.884563:0:8429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788305423.884566:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305423.884567:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305423.884568:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305423.884575:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305423.884576:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305423.884577:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305423.884578:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305423.884579:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305423.884580:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305423.884581:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305423.884581:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305423.884606:0:8429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788305423.884625:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015129472:0@lo:253: 00000100:00100000:1.0:1788305423.884696:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305423.884730:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305423.885039:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129472 00000100:00100000:0.0:1788305423.885047:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129472 00000100:00100000:0.0:1788305423.885099:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305423.885109:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015129472:12345-0@lo:253: 20000000:01000000:0.0:1788305423.885136:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788305423.885151:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305423.891947:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305423.891991:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788305423.892412:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:8429:x1875174015129472:12345-0@lo:253: Request processed in 7300us (7711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.892426:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305423.892732:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:8429:1875174015129472:0@lo:253: 10000000:01000000:1.0:1788305423.892746:0:8429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788305423.892750:0:8429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305423.892752:0:8429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305423.892753:0:8429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305423.892755:0:8429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305423.892756:0:8429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305423.892757:0:8429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305423.892758:0:8429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305423.892760:0:8429:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305423.892761:0:8429:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305423.892763:0:8429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305423.892764:0:8429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788305423.892777:0:8429:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788305423.894488:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788305423.894498:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788305423.894528:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894597:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531a1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894606:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60531bd expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894613:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894656:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894671:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.894684:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015129600:0@lo:104: 00000100:00100000:0.0:1788305423.894753:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305423.894866:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305423.894876:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305423.894884:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015129728:0@lo:104: 00000100:00100000:0.0:1788305423.894905:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305423.899633:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788305423.899678:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305423.899713:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129600 00000100:00100000:3.0:1788305423.899721:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129600 00000100:00100000:3.0:1788305423.899754:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129728 00000100:00100000:3.0:1788305423.899757:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129728 00000100:00100000:3.0:1788305423.899772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305423.899780:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891badf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015129600:12345-0@lo:104: 00010000:00010000:3.0:1788305423.899808:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788305423.900631:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788305423.900838:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788305423.901066:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788305423.901219:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788305423.901616:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:3.0:1788305423.901928:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305423.901939:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891badf4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015129600:12345-0@lo:104: Request processed in 2157us (7183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.901950:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305423.901997:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305423.902007:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015129728:12345-0@lo:104: 00010000:00010000:3.0:1788305423.902022:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305423.902089:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788305423.902094:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015129728:12345-0@lo:104: Request processed in 90us (2418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305423.902101:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788305423.902165:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305423.902172:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902179:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ac00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.902184:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902192:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.902199:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.902204:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.902247:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902254:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.902290:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902308:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e60531bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531c4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902320:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305423.902323:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902329:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523bc00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305423.902332:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902339:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305423.902345:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305423.902350:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305423.902365:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902371:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305423.902386:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902393:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e60531a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60531a8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902405:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.902412:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.902414:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305423.902420:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305423.902434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015129856:0@lo:103: 00000100:00100000:2.0:1788305423.902472:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.902509:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305423.902516:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015129984:0@lo:103: 00000100:00100000:2.0:1788305423.902538:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305423.902581:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129856 00000100:00100000:2.0:1788305423.902589:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129856 00010000:00010000:2.0:1788305423.902612:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 16 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305423.902634:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015129984 00000100:00100000:2.0:1788305423.902637:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015129984 00010000:00010000:2.0:1788305423.902649:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 17 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305423.902669:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305423.902675:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3647:x1875174015129856:12345-0@lo:103: 00010000:00010000:2.0:1788305423.902686:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305423.902692:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 17 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902702:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 17 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902720:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305423.902748:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3647:x1875174015129856:12345-0@lo:103: Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.902764:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305423.902777:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305423.902793:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+16:3647:x1875174015129984:12345-0@lo:103: 00010000:00010000:2.0:1788305423.902802:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305423.902807:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 16 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902816:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 16 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902828:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902836:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788305423.902850:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008352336s 00010000:00010000:2.0:1788305423.902855:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902862:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902869:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902876:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902881:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523aa00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305423.902904:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902911:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902920:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.902930:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305423.902955:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+16:3647:x1875174015129984:12345-0@lo:103: Request processed in 171us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305423.902962:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305423.903002:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015129984:0@lo:103: 00000100:00100000:2.0:1788305423.903010:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015129856:0@lo:103: 00080000:10000000:1.0:1788305423.903576:0:8429:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:2.0:1788305423.903801:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666a00/0x4a426866e60531c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60531bd expref: 15 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305423.903812:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015129600:0@lo:104: 00010000:00010000:2.0:1788305423.903824:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666c00/0x4a426866e60531a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60531a1 expref: 14 pid: 6512 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305423.903830:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015129728:0@lo:104: 00010000:00010000:2.0:1788305423.903846:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.903855:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.903872:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305423.903878:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523aa00/0x4a426866e60532b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788305423.904956:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788305423.914172:0:8429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788305423.914194:0:8429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788305423.914235:0:8429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788305423.914510:0:8429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788305423.914535:0:8429:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788305423.914567:0:8429:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788305423.915330:0:8429:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305423.917761:0:8429:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788305424.469496:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305425.107086:0:8513:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305425.107463:0:8513:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305425.495267:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305426.518306:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305427.541434:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305427.927641:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015130112:0@lo:41: 00000100:00100000:2.0:1788305427.927713:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305427.928803:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130112 00000100:00100000:3.0:1788305427.928816:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130112 00000100:00100000:3.0:1788305427.928881:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305427.928891:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015130112:12345-0@lo:41: 00000004:00000024:3.0:1788305427.928930:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788305427.928994:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015130112:12345-0@lo:41: Request processed in 104us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305427.929001:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305427.929394:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015130112:0@lo:41: 00000100:00100000:1.0:1788305427.929901:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015130240:0@lo:41: 00000100:00100000:1.0:1788305427.929944:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305427.930909:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130240 00000100:00100000:3.0:1788305427.930918:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130240 00000100:00100000:3.0:1788305427.930963:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305427.930972:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015130240:12345-0@lo:41: 00000004:00000024:3.0:1788305427.931002:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788305427.931060:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015130240:12345-0@lo:41: Request processed in 89us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305427.931066:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305427.931173:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015130240:0@lo:41: 00010000:00010000:2.0:1788305428.574104:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305428.952028:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015130496:0@lo:400: 00000100:00100000:1.0:1788305428.952095:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952150:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015131008:0@lo:400: 00000100:00100000:1.0:1788305428.952176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952201:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305428.952207:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015130368:0@lo:400: 00000100:00100000:1.0:1788305428.952251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952297:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015130880:0@lo:400: 00000100:00100000:1.0:1788305428.952324:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952351:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015130624:0@lo:400: 00000100:00100000:1.0:1788305428.952374:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952393:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015131136:0@lo:400: 00000100:00100000:1.0:1788305428.952416:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.952443:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305428.952450:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015130752:0@lo:400: 00000100:00100000:2.0:1788305428.952638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130496 00000100:00100000:2.0:1788305428.952645:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130496 00000100:00100000:2.0:1788305428.952683:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131008 00000100:00100000:2.0:1788305428.952687:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131008 00000100:00100000:2.0:1788305428.952709:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131136 00000100:00100000:2.0:1788305428.952712:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131136 00000100:00100000:2.0:1788305428.952728:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305428.952736:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015130496:12345-0@lo:400: 00000100:00100000:2.0:1788305428.952807:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015130496:12345-0@lo:400: Request processed in 71us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.952814:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305428.952831:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305428.952838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015131008:12345-0@lo:400: 00000100:00100000:2.0:1788305428.952862:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015131008:12345-0@lo:400: Request processed in 26us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.952879:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305428.952891:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305428.952897:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015131136:12345-0@lo:400: 00000100:00100000:2.0:1788305428.952924:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015131136:12345-0@lo:400: Request processed in 27us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.952929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305428.952967:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130880 00000100:00100000:2.0:1788305428.952971:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130880 00000100:00100000:2.0:1788305428.952991:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130624 00000100:00100000:2.0:1788305428.952994:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130624 00000100:00100000:2.0:1788305428.953006:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305428.953012:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015130880:12345-0@lo:400: 00000100:00100000:2.0:1788305428.953043:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015130880:12345-0@lo:400: Request processed in 31us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.953050:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305428.953062:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305428.953068:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015130624:12345-0@lo:400: 00000100:00100000:2.0:1788305428.953094:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015130624:12345-0@lo:400: Request processed in 26us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.953099:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305428.953114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130368 00000100:00100000:2.0:1788305428.953118:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130368 00000100:00100000:2.0:1788305428.953140:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788305428.953145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:3648:x1875174015130368:12345-0@lo:400: 00000100:00100000:2.0:1788305428.953173:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:3648:x1875174015130368:12345-0@lo:400: Request processed in 28us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305428.953189:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788305428.953259:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015130368:0@lo:400: 00000100:00100000:2.0:1788305428.953271:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015130880:0@lo:400: 00010000:00080000:2.0:1788305428.953307:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ca80 x1875174015130496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305428.953317:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015130496:0@lo:400: 00010000:00080000:2.0:1788305428.953332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209e300 x1875174015131008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305428.953341:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015131008:0@lo:400: 00000100:00080000:0.0:1788305428.953748:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305428.953753:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305428.953849:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305428.953879:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015130624:0@lo:400: 00010000:00080000:1.0:1788305428.953899:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ea00 x1875174015131136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305428.953908:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015131136:0@lo:400: 00000100:00100000:1.0:1788305428.953928:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015130752 00000100:00100000:1.0:1788305428.953931:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015130752 00000100:00100000:1.0:1788305428.953956:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305428.953962:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015130752:12345-0@lo:400: 00000100:00100000:1.0:1788305428.954045:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015130752:12345-0@lo:400: Request processed in 82us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305428.954051:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788305428.960385:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209f480 x1875174015130752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305428.960853:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015130752:0@lo:400: 00010000:00010000:2.0:1788305429.601802:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788305430.490397:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788305430.490406:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891894cd800 from 30 10000000:01000000:2.0:1788305430.490411:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305430.490458:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.490480:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.490491:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305430.490515:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131264:0@lo:101: 00000100:00100000:2.0:1788305430.490587:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.490654:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.491018:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131264 00000100:00100000:1.0:1788305430.491028:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131264 00000100:00100000:1.0:1788305430.491090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305430.491104:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:6516:x1875174015131264:12345-0@lo:101: 00010000:00010000:1.0:1788305430.491119:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305430.491134:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60532b9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.491158:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60532b9 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.491169:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532b9 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.491178:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181666a00, rc 0) 00000100:00100000:1.0:1788305430.491232:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131264:12345-0@lo:101: Request processed in 132us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.491241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305430.491338:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131264:0@lo:101: 00010000:00010000:1.0:1788305430.491359:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.491369:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.491432:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131392:0@lo:501: 00000100:00100000:1.0:1788305430.491478:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.491522:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.491543:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131392 00000100:00100000:1.0:1788305430.491548:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131392 00000100:00100000:1.0:1788305430.491581:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305430.491590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131392:12345-0@lo:501: 00000100:00100000:1.0:1788305430.491701:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131392:12345-0@lo:501: Request processed in 113us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.491708:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305430.491745:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131392:0@lo:501: 00000100:00100000:1.0:1788305430.491770:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131520:0@lo:503: 00000100:00100000:1.0:1788305430.491808:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.491821:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.491835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131520 00000100:00100000:1.0:1788305430.491838:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131520 00000100:00100000:1.0:1788305430.491854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305430.491860:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131520:12345-0@lo:503: 00000100:00100000:1.0:1788305430.492349:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131520:12345-0@lo:503: Request processed in 486us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.492366:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305430.492420:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131520:0@lo:503: 00000100:00100000:2.0:1788305430.494905:0:8746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8746:1875174015131648:0@lo:502: 00000100:00100000:2.0:1788305430.494993:0:8746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.495053:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131648 00000100:00100000:1.0:1788305430.495060:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131648 00000100:00100000:1.0:1788305430.495102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305430.495112:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8746:x1875174015131648:12345-0@lo:502: 00000100:00100000:1.0:1788305430.495263:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:8746:x1875174015131648:12345-0@lo:502: Request processed in 152us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.495270:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788305430.503865:0:8746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.503926:0:8746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8746:1875174015131648:0@lo:502: 00000100:00100000:2.0:1788305430.504019:0:8746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8746:1875174015131776:0@lo:502: 00000100:00100000:2.0:1788305430.504094:0:8746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.504114:0:8746:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.504434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131776 00000100:00100000:1.0:1788305430.504443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131776 00000100:00100000:1.0:1788305430.504500:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788305430.504510:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:8746:x1875174015131776:12345-0@lo:502: 00000100:00100000:1.0:1788305430.504619:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:8746:x1875174015131776:12345-0@lo:502: Request processed in 110us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.504627:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788305430.505635:0:8746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8746:1875174015131776:0@lo:502: 00000040:00080000:2.0:1788305430.505671:0:8746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788305430.506057:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788305430.506078:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305430.506088:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.506099:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305430.506108:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305430.506111:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891894cd800 from 5 10000000:01000000:1.0:1788305430.506113:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305430.506155:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.506163:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.506171:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.506187:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131904:0@lo:101: 00000100:00100000:1.0:1788305430.506238:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.506308:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.507127:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015131904 00000100:00100000:2.0:1788305430.507135:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015131904 00000100:00100000:2.0:1788305430.507189:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788305430.507199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015131904:12345-0@lo:101: 00010000:00010000:2.0:1788305430.507213:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305430.507228:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60532c7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.507252:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60532c7 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.507262:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532c7 expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.507272:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683400, rc 0) 00000100:00100000:2.0:1788305430.507335:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015131904:12345-0@lo:101: Request processed in 137us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.507341:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788305430.507631:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015131904:0@lo:101: 00010000:00010000:1.0:1788305430.507647:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.507655:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.509314:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132032:0@lo:256: 00000100:00100000:1.0:1788305430.509388:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.509430:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.510046:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132032 00000100:00100000:2.0:1788305430.510065:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132032 00000100:00100000:2.0:1788305430.510119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788305430.510130:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015132032:12345-0@lo:256: 20000000:01000000:2.0:1788305430.510154:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305430.510172:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305430.510176:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788305430.510269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015132032:12345-0@lo:256: Request processed in 140us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.510303:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788305430.510585:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132032:0@lo:256: 10000000:01000000:1.0:1788305430.510643:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305430.510653:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.510664:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305430.511206:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788305430.511211:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1788305430.511214:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788305430.511252:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.511261:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.511271:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.511687:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132160:0@lo:101: 00000100:00100000:1.0:1788305430.511749:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.511786:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.511805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132160 00000100:00100000:1.0:1788305430.511811:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132160 00000100:00100000:1.0:1788305430.511849:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788305430.511857:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015132160:12345-0@lo:101: 00010000:00010000:1.0:1788305430.511867:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305430.511880:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60532d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.511916:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60532d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.511926:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532d5 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.511945:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181667c00, rc 0) 00000100:00100000:1.0:1788305430.511980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015132160:12345-0@lo:101: Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.511987:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788305430.512026:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132160:0@lo:101: 00010000:00010000:1.0:1788305430.512039:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.512048:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.512098:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132288:0@lo:501: 00000100:00100000:1.0:1788305430.512121:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.512133:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.512146:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132288 00000100:00100000:1.0:1788305430.512149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132288 00000100:00100000:1.0:1788305430.512170:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788305430.512176:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015132288:12345-0@lo:501: 00000100:00100000:1.0:1788305430.512301:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015132288:12345-0@lo:501: Request processed in 124us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.512308:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788305430.512336:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132288:0@lo:501: 00000100:00100000:1.0:1788305430.512359:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132416:0@lo:503: 00000100:00100000:1.0:1788305430.512393:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.512414:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.512428:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132416 00000100:00100000:1.0:1788305430.512431:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132416 00000100:00100000:1.0:1788305430.512449:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305430.512454:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015132416:12345-0@lo:503: 00000100:00100000:1.0:1788305430.512539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015132416:12345-0@lo:503: Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.512546:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305430.512583:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015132416:0@lo:503: 00000100:00100000:1.0:1788305430.512775:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8747:1875174015132544:0@lo:502: 00000100:00100000:1.0:1788305430.512810:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.512825:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.512840:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132544 00000100:00100000:0.0:1788305430.512923:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132544 00000100:00100000:0.0:1788305430.512947:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788305430.512954:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:8747:x1875174015132544:12345-0@lo:502: 00000100:00100000:0.0:1788305430.513033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:8747:x1875174015132544:12345-0@lo:502: Request processed in 80us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.513040:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305430.514109:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8747:1875174015132544:0@lo:502: 00000020:01000000:1.0:1788305430.514137:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305430.514145:0:8747:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788305430.514152:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305430.514154:0:8747:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788305430.514158:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305430.514161:0:8747:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:1.0:1788305430.514181:0:8747:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788305430.514184:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305430.514197:0:8747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8891b917cd28) 00000020:00000080:1.0:1788305430.514218:0:8747:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:1.0:1788305430.514223:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305430.514342:0:8747:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788305430.514349:0:8747:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788305430.514364:0:8747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e60532ea 00010000:00080000:1.0:1788305430.514389:0:8747:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908273e000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305430.514614:0:8747:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788305430.553620:0:8747:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788305430.553642:0:8747:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788305430.553848:0:8747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305430.554042:0:8747:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305430.554115:0:8747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788305430.554189:0:8747:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788305430.558565:0:8750:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305430.558573:0:8750:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788305430.562525:0:8747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788305430.562542:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305430.562588:0:8747:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788305430.562612:0:8747:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e60532f1 00000100:00080000:1.0:1788305430.562623:0:8747:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305430.562629:0:8747:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305430.562664:0:8747:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff88908209ea00 x1875174015132672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305430.562890:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015132672:0@lo:8: 00000100:00100000:2.0:1788305430.562960:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305430.563033:0:8747:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788305430.563096:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305430.563100:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305430.563102:0:8747:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788305430.563104:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305430.563108:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305430.563109:0:8747:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305430.563112:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305430.563114:0:8747:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788305430.563139:0:8747:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8747:1875174015132800:0@lo:502: 00000100:00100000:1.0:1788305430.563189:0:8747:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.563206:0:8747:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305430.563351:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132672 00000100:00100000:3.0:1788305430.563358:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132672 00000100:00100000:3.0:1788305430.563391:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305430.563398:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875174015132672:12345-0@lo:8: 00010000:00080000:3.0:1788305430.563421:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788305430.563443:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e60532f8 00002000:00100000:3.0:1788305430.563485:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8891b8f71000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788305430.563489:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:3.0:1788305430.563493:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788305430.563548:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305430.563775:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788305430.563800:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8891b8f74800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305430.564146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132800 00000100:00100000:0.0:1788305430.564151:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132800 00000100:00100000:0.0:1788305430.564182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788305430.564189:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:8747:x1875174015132800:12345-0@lo:502: 00000100:00100000:0.0:1788305430.564311:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:8747:x1875174015132800:12345-0@lo:502: Request processed in 122us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.564319:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788305430.564360:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015133312:0@lo:400: 00000100:00100000:0.0:1788305430.564399:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.564424:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788305430.564431:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015132928:0@lo:400: 00000100:00100000:0.0:1788305430.564454:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.564478:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015133440:0@lo:400: 00000100:00100000:0.0:1788305430.564501:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.564530:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015132928 00000100:00100000:0.0:1788305430.564534:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015132928 00000100:00100000:0.0:1788305430.564556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133440 00000100:00100000:0.0:1788305430.564559:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133440 00000100:00100000:0.0:1788305430.564580:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305430.564586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015132928:12345-0@lo:400: 00000100:00100000:0.0:1788305430.564621:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015132928:12345-0@lo:400: Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.564627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305430.564637:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305430.564643:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015133440:12345-0@lo:400: 00000100:00100000:0.0:1788305430.564664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015133440:12345-0@lo:400: Request processed in 21us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.564669:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788305430.564683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305430.564706:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e00e00 x1875174015132928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.564718:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015132928:0@lo:400: 00010000:00080000:0.0:1788305430.564742:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e02680 x1875174015133440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.564750:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015133440:0@lo:400: 00000100:00100000:1.0:1788305430.566479:0:8747:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8747:1875174015132800:0@lo:502: 00000020:01000000:1.0:1788305430.566523:0:8747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305430.566533:0:8747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305430.566535:0:8747:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788305430.566540:0:8747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1788305430.566622:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788305430.566641:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788305430.566651:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.566687:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305430.566699:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788305430.566701:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a3800 from 30 10000000:01000000:1.0:1788305430.566704:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305430.566744:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.566752:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.566761:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.566779:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133696:0@lo:101: 00000100:00100000:1.0:1788305430.566833:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.566877:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.566892:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133696 00000100:00100000:1.0:1788305430.566898:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133696 00000100:00100000:1.0:1788305430.566944:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305430.566952:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015133696:12345-0@lo:101: 00010000:00010000:1.0:1788305430.566963:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305430.566975:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60532ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.566996:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60532ff expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.567019:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532ff expref: 18 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.567027:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181667a00, rc 0) 00000100:00100000:1.0:1788305430.567059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015133696:12345-0@lo:101: Request processed in 109us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.567065:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305430.567114:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133696:0@lo:101: 00010000:00010000:1.0:1788305430.567124:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305430.567131:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305430.567172:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133824:0@lo:501: 00000100:00100000:1.0:1788305430.567194:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.567208:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.567332:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133824 00000100:00100000:1.0:1788305430.567336:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133824 00000100:00100000:1.0:1788305430.567358:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305430.567364:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015133824:12345-0@lo:501: 00000100:00100000:1.0:1788305430.567479:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015133824:12345-0@lo:501: Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.567485:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305430.567514:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133824:0@lo:501: 00000100:00100000:1.0:1788305430.567539:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133952:0@lo:503: 00000100:00100000:1.0:1788305430.567577:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.567588:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305430.567598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133952 00000100:00100000:1.0:1788305430.567601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133952 00000100:00100000:1.0:1788305430.567621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788305430.567627:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015133952:12345-0@lo:503: 00000100:00100000:1.0:1788305430.567697:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015133952:12345-0@lo:503: Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.567705:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788305430.567759:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015133952:0@lo:503: 00000100:00100000:1.0:1788305430.571703:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133312 00000100:00100000:1.0:1788305430.571730:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133312 00000100:00100000:1.0:1788305430.571799:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305430.571811:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015133312:12345-0@lo:400: 00000100:00100000:1.0:1788305430.571917:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015133312:12345-0@lo:400: Request processed in 108us (7517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.571926:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788305430.571955:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015133184:0@lo:400: 00000100:00100000:1.0:1788305430.571992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.572021:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305430.572030:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015133056:0@lo:400: 00000100:00100000:1.0:1788305430.572055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.572072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015133568:0@lo:400: 00000100:00100000:1.0:1788305430.572091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.572149:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015133312:0@lo:400: 00000100:00100000:1.0:1788305430.572172:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133184 00000100:00100000:1.0:1788305430.572192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133184 00000100:00100000:1.0:1788305430.572210:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133568 00000100:00100000:1.0:1788305430.572212:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133568 00000100:00100000:1.0:1788305430.572240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305430.572246:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015133184:12345-0@lo:400: 00000100:00100000:1.0:1788305430.572300:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015133184:12345-0@lo:400: Request processed in 54us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.572307:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305430.572318:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305430.572324:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015133568:12345-0@lo:400: 00000100:00100000:1.0:1788305430.572349:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015133568:12345-0@lo:400: Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.572355:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788305430.572373:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788305430.572390:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e00000 x1875174015133568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.572399:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015133568:0@lo:400: 00010000:00080000:1.0:1788305430.572408:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e00a80 x1875174015133184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.572416:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015133184:0@lo:400: 00000100:00100000:3.0:1788305430.577960:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015132672:12345-0@lo:8: Request processed in 14446us (14885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305430.577977:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788305430.578107:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ea00 x1875174015132672/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305430.578120:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305430.578130:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788305430.578139:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305430.578145:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788305430.578148:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305430.578202:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305430.578208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015132672:0@lo:8: 00000100:00100000:2.0:1788305430.578434:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015133056 00000100:00100000:2.0:1788305430.578443:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015133056 00000004:00080000:3.0:1788305430.578629:0:8750:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788305430.578713:0:8750:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 260669437394ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788305430.578720:0:8750:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788305430.579897:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305430.579916:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015133056:12345-0@lo:400: 00000100:00100000:2.0:1788305430.580038:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015133056:12345-0@lo:400: Request processed in 130us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.580046:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305430.580124:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015133056:0@lo:400: 00000100:00100000:2.0:1788305430.580311:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8752:1875174015134080:0@lo:502: 00000100:00100000:2.0:1788305430.580361:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.580389:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134080 00000100:00100000:2.0:1788305430.580395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134080 00000100:00100000:2.0:1788305430.580423:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788305430.580431:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:8752:x1875174015134080:12345-0@lo:502: 00000100:00100000:2.0:1788305430.584834:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:8752:x1875174015134080:12345-0@lo:502: Request processed in 4393us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.584848:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788305430.584954:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.584979:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8752:1875174015134080:0@lo:502: 00000100:00100000:2.0:1788305430.585047:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8752:1875174015134208:0@lo:502: 00000100:00100000:2.0:1788305430.585097:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.585129:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134208 00000100:00100000:2.0:1788305430.585135:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134208 00000100:00100000:2.0:1788305430.585172:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788305430.585181:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:8752:x1875174015134208:12345-0@lo:502: 00000100:00100000:2.0:1788305430.585252:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:8752:x1875174015134208:12345-0@lo:502: Request processed in 73us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.585259:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788305430.585305:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.585318:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8752:1875174015134208:0@lo:502: 00000040:00080000:2.0:1788305430.585334:0:8752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788305430.585401:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788305430.585420:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305430.585435:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.585446:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305430.585455:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305430.585457:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a3800 from 5 10000000:01000000:2.0:1788305430.585460:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305430.589061:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.589079:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.589092:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305430.589119:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134336:0@lo:101: 00000100:00100000:2.0:1788305430.589187:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.589223:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.589255:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134336 00000100:00100000:2.0:1788305430.589262:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134336 00000100:00100000:2.0:1788305430.589318:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788305430.589327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015134336:12345-0@lo:101: 00010000:00010000:2.0:1788305430.589339:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305430.589350:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605330d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.589374:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605330d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.589392:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605330d expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.589401:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683600, rc 0) 00000100:00100000:2.0:1788305430.589443:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015134336:12345-0@lo:101: Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.589450:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788305430.591060:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134336:0@lo:101: 00010000:00010000:2.0:1788305430.591087:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.591098:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305430.591165:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134464:0@lo:256: 00000100:00100000:2.0:1788305430.591220:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.591246:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb525b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.591264:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134464 00000100:00100000:2.0:1788305430.591269:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134464 00000100:00100000:2.0:1788305430.591322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305430.591330:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015134464:12345-0@lo:256: 20000000:01000000:2.0:1788305430.591346:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305430.591362:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305430.591365:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788305430.591452:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015134464:12345-0@lo:256: Request processed in 123us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.592853:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015134592:0@lo:700: 00000100:00100000:1.0:1788305430.592924:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.593073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305430.593149:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134464:0@lo:256: 10000000:01000000:2.0:1788305430.593205:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788305430.593214:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.593224:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305430.593232:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788305430.593235:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788305430.593237:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305430.593258:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.593265:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.593287:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305430.593298:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134720:0@lo:101: 00000100:00100000:2.0:1788305430.593323:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.593343:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.593360:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134720 00000100:00100000:2.0:1788305430.593365:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134720 00000100:00100000:2.0:1788305430.593394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788305430.593402:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015134720:12345-0@lo:101: 00010000:00010000:2.0:1788305430.593413:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305430.593436:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605331b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.595526:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605331b expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.595548:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605331b expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.595558:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181683200, rc 0) 00000100:00100000:2.0:1788305430.595642:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015134720:12345-0@lo:101: Request processed in 2240us (2316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.595652:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788305430.595732:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134720:0@lo:101: 00010000:00010000:2.0:1788305430.595750:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305430.595759:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305430.595837:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134848:0@lo:501: 00000100:00100000:2.0:1788305430.596151:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.596173:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.596193:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134848 00000100:00100000:2.0:1788305430.596199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134848 00000100:00100000:2.0:1788305430.596230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788305430.596240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015134848:12345-0@lo:501: 00000100:00100000:2.0:1788305430.596372:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015134848:12345-0@lo:501: Request processed in 134us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.596378:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788305430.598703:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134848:0@lo:501: 00000100:00100000:2.0:1788305430.598771:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134976:0@lo:503: 00000100:00100000:2.0:1788305430.598845:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.598888:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305430.599074:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134976 00000100:00100000:3.0:1788305430.599082:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134976 00000100:00100000:3.0:1788305430.599133:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305430.599144:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015134976:12345-0@lo:503: 00000100:00100000:3.0:1788305430.599255:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015134976:12345-0@lo:503: Request processed in 113us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305430.599263:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305430.599333:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015134976:0@lo:503: 00000100:00100000:3.0:1788305430.599572:0:8753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8753:1875174015135104:0@lo:502: 00000100:00100000:3.0:1788305430.599658:0:8753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305430.599687:0:8753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.600103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135104 00000100:00100000:2.0:1788305430.600108:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135104 00000100:00100000:2.0:1788305430.600138:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788305430.600145:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:8753:x1875174015135104:12345-0@lo:502: 00000100:00100000:2.0:1788305430.600233:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:8753:x1875174015135104:12345-0@lo:502: Request processed in 88us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.600240:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788305430.600360:0:8753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8753:1875174015135104:0@lo:502: 00000020:01000000:3.0:1788305430.600383:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788305430.600392:0:8753:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788305430.600399:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305430.600401:0:8753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788305430.600406:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788305430.600409:0:8753:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:3.0:1788305430.600439:0:8753:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788305430.600442:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305430.600457:0:8753:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8891b8fa4d28) 00000020:00000080:3.0:1788305430.600488:0:8753:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788305430.600495:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788305430.600569:0:8753:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788305430.600574:0:8753:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788305430.600580:0:8753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6053330 00010000:00080000:3.0:1788305430.600607:0:8753:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8890825d6000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.155@tcp at head 00000100:00100000:1.0:1788305430.600984:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00010000:00010000:3.0:1788305430.601084:0:8753:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:0.0:1788305430.606193:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015134592 00000100:00100000:0.0:1788305430.606211:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015134592 00000100:00100000:0.0:1788305430.606312:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305430.606323:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8751:x1875174015134592:12345-0@lo:700: 00000100:00100000:0.0:1788305430.606386:0:8444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875174015135232:0@lo:700: 00000100:00100000:0.0:1788305430.606457:0:8444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.606491:0:8444:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2ccc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788305430.606507:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305430.608265:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135232 00000100:00100000:3.0:1788305430.608292:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135232 00000100:00100000:3.0:1788305430.608342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305430.608352:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875174015135232:12345-0@lo:700: 00000004:00080000:3.0:1788305430.609010:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00010000:2.0:1788305430.622817:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788305430.643828:0:8753:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788305430.643853:0:8753:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 40000000:02000000:2.0:1788305430.644073:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:00080000:3.0:1788305430.644089:0:8753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305430.644311:0:8753:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305430.644395:0:8753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788305430.644940:0:8753:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788305430.647947:0:8754:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305430.647959:0:8754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788305430.659527:0:8753:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788305430.659544:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788305430.659588:0:8753:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788305430.659614:0:8753:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6053337 00000100:00080000:3.0:1788305430.659625:0:8753:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305430.659631:0:8753:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8890825d6000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305430.659670:0:8753:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8d47b80 x1875174015135360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305430.659694:0:8753:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788305430.659772:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305430.659777:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305430.659779:0:8753:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788305430.659782:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305430.659786:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305430.659788:0:8753:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305430.659790:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305430.659792:0:8753:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788305430.659834:0:8753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8753:1875174015135488:0@lo:502: 00000100:00100000:3.0:1788305430.659935:0:8753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305430.659994:0:8753:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.660066:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015135360:0@lo:8: 00000100:00100000:0.0:1788305430.660102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.662041:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135488 00000100:00100000:0.0:1788305430.662052:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135488 00000100:00100000:0.0:1788305430.662105:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788305430.662113:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:8753:x1875174015135488:12345-0@lo:502: 00000100:00100000:0.0:1788305430.662266:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:8753:x1875174015135488:12345-0@lo:502: Request processed in 153us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.662295:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788305430.662352:0:8753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:8753:1875174015135488:0@lo:502: 00000020:01000000:0.0:1788305430.662383:0:8753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305430.662389:0:8753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305430.662392:0:8753:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788305430.662396:0:8753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788305430.662522:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788305430.662545:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305430.662554:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305430.662564:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305430.662573:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788305430.662581:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889186788000 from 1 10000000:01000000:0.0:1788305430.662584:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305430.662609:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305430.662617:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305430.662627:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305430.662642:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015135616:0@lo:101: 00000100:00100000:0.0:1788305430.662672:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.662697:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb524480 going to sleep for 11 seconds 00000100:00100000:3.0:1788305430.662828:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135360 00000100:00100000:3.0:1788305430.662833:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135360 00000100:00100000:3.0:1788305430.662859:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305430.662865:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875174015135360:12345-0@lo:8: 00010000:00080000:3.0:1788305430.662886:0:8437:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788305430.662910:0:8437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6053345 00002000:00100000:3.0:1788305430.662922:0:8437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff889082754000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788305430.662933:0:8437:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788305430.662936:0:8437:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305430.662994:0:8437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788305430.663015:0:8437:0:(import.c:65:import_set_state_nolock()) ffff889082757800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305430.663051:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015135360:12345-0@lo:8: Request processed in 186us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305430.663058:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788305430.663541:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8d47b80 x1875174015135360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.663552:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305430.663558:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788305430.663566:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788305430.663570:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788305430.663573:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890825d6000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788305430.663582:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788305430.663587:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015135360:0@lo:8: 00000004:00080000:3.0:1788305430.664031:0:8754:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788305430.667306:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135616 00000100:00100000:3.0:1788305430.667322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135616 00000100:00100000:3.0:1788305430.667400:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788305430.667412:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015135616:12345-0@lo:101: 00010000:00010000:3.0:1788305430.668904:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305430.668929:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605333e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305430.668962:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305430.668973:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305430.668983:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305430.669061:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015135616:12345-0@lo:101: Request processed in 1651us (6388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305430.669069:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788305430.669134:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015135616:0@lo:101: 00010000:00010000:3.0:1788305430.669155:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305430.669177:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305430.669249:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015135744:0@lo:501: 00000100:00100000:3.0:1788305430.669295:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305430.669323:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305430.669336:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135744 00000100:00100000:3.0:1788305430.669340:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135744 00000100:00100000:3.0:1788305430.669368:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788305430.669376:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015135744:12345-0@lo:501: 00000100:00100000:3.0:1788305430.669464:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015135744:12345-0@lo:501: Request processed in 89us (168us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305430.669471:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788305430.669499:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015135744:0@lo:501: 10000000:01000000:3.0:1788305430.669522:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788305430.669527:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305430.669534:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305430.669719:0:8754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 260760442490ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788305430.669736:0:8754:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788305430.670450:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8444:x1875174015135232:12345-0@lo:700: Request processed in 62096us (63990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.670460:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788305430.670588:0:8444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082051180 x1875174015135232/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305430.670601:0:8444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8444:1875174015135232:0@lo:700: 40000000:02000000:2.0:1788305430.670611:0:8444:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000004:00080000:0.0:1788305430.681876:0:8755:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788305430.681889:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305430.681910:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015135872:0@lo:13: 00000100:00100000:0.0:1788305430.681916:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136000:0@lo:7: 00000100:00100000:1.0:1788305430.682158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.684380:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015135872 00000100:00100000:2.0:1788305430.684391:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015135872 00000100:00100000:2.0:1788305430.684448:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305430.684458:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015135872:12345-0@lo:13: 00002000:00000024:2.0:1788305430.684490:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788305430.684576:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015135872:12345-0@lo:13: Request processed in 120us (2420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.684582:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788305430.684602:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305430.684645:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082053100 x1875174015135872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305430.684669:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015135872:0@lo:13: 00000100:00100000:0.0:1788305430.688312:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.688377:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb524780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.689355:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136000 00000100:00100000:0.0:1788305430.689366:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136000 00000100:00100000:0.0:1788305430.689416:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305430.689425:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8755:x1875174015136000:12345-0@lo:7: 00002000:00080000:1.0:1788305430.701510:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788305430.701520:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788305430.701617:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8755:x1875174015136000:12345-0@lo:7: Request processed in 12188us (13308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.701640:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305430.703452:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082050700 x1875174015136000/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.703471:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136000:0@lo:7: 00000004:00080000:0.0:1788305430.703501:0:8755:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788305430.703549:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136128:0@lo:5: 00000100:00100000:0.0:1788305430.703603:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.703645:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136128 00000100:00100000:0.0:1788305430.703652:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136128 00000100:00100000:0.0:1788305430.703705:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305430.703714:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8755:x1875174015136128:12345-0@lo:5: 00002000:00080000:0.0:1788305430.703754:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788305430.703759:0:8436:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788305430.704080:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb524780 going to sleep for 11 seconds 00000001:00100000:1.0:1788305430.704135:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788305430.704141:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:2.0:1788305430.705233:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788305430.705912:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015134592:12345-0@lo:700: Request processed in 99586us (112983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.705928:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1788305430.712572:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1788305430.712700:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8755:x1875174015136128:12345-0@lo:5: Request processed in 8983us (9092us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788305430.712710:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788305430.715661:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082050700 x1875174015136128/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.715677:0:8755:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788305430.715684:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136128:0@lo:5: 00000004:00080000:1.0:1788305430.715702:0:8755:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788305430.715762:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136256:0@lo:700: 00000100:00100000:1.0:1788305430.715815:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.715859:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2180 going to sleep for 11 seconds 00010000:00080000:0.0:1788305430.715866:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ca80 x1875174015134592/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.715878:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015134592:0@lo:700: 00000100:00100000:0.0:1788305430.715941:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136256 00000100:00100000:0.0:1788305430.715948:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136256 00000100:00100000:0.0:1788305430.715995:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305430.716003:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8755:x1875174015136256:12345-0@lo:700: 00000100:00100000:3.0:1788305430.727478:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8755:x1875174015136256:12345-0@lo:700: Request processed in 11466us (11653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305430.727554:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305430.727611:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209c700 x1875174015136256/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305430.727637:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136256:0@lo:700: 00000004:02000040:0.0:1788305430.732834:0:8755:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788305430.740371:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136384:0@lo:5: 00000100:00100000:0.0:1788305430.740448:0:8755:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305430.743039:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb524e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305430.743366:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136384 00000100:00100000:3.0:1788305430.743376:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136384 00000100:00100000:3.0:1788305430.743422:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305430.743431:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8755:x1875174015136384:12345-0@lo:5: 00000100:00100000:2.0:1788305430.744686:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015136512:0@lo:13: 00000100:00100000:2.0:1788305430.744757:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.744811:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136512 00000100:00100000:2.0:1788305430.744816:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136512 00000100:00100000:2.0:1788305430.744848:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305430.744855:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015136512:12345-0@lo:13: 00002000:00000024:2.0:1788305430.744872:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788305430.745619:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015136512:12345-0@lo:13: Request processed in 760us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305430.745627:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788305430.745671:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88918356f800 x1875174015136512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305430.745692:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015136512:0@lo:13: 00000004:00080000:2.0:1788305430.745716:0:8751:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788305430.745748:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136640:0@lo:7: 00000100:00100000:2.0:1788305430.745775:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.745805:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788305430.745812:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788305430.745833:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.747059:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788305430.747073:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136640 00000100:00100000:0.0:1788305430.747079:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136640 00000100:00100000:0.0:1788305430.747236:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305430.747246:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015136640:12345-0@lo:7: 00002000:00080000:3.0:1788305430.761381:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788305430.761401:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:2.0:1788305430.769951:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8755:x1875174015136384:12345-0@lo:5: Request processed in 26514us (29496us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788305430.769964:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788305430.770026:0:8755:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082052680 x1875174015136384/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.770058:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082052680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8755:1875174015136384:0@lo:5: 00000004:00080000:1.0:1788305430.770076:0:8755:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00002000:00080000:1.0:1788305430.777144:0:8758:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788305430.777156:0:8758:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788305430.777260:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015136640:12345-0@lo:7: Request processed in 30011us (31480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305430.777271:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788305430.777596:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88918356f800 x1875174015136640/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305430.777613:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136640:0@lo:7: 00000004:00080000:2.0:1788305430.777630:0:8751:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788305430.777670:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136768:0@lo:5: 00000100:00100000:2.0:1788305430.777708:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305430.777747:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.777754:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136768 00000100:00100000:0.0:1788305430.777761:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136768 00000100:00100000:0.0:1788305430.777808:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305430.777818:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015136768:12345-0@lo:5: 00002000:00080000:0.0:1788305430.777843:0:8437:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788305430.777902:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015136768:12345-0@lo:5: Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.777909:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788305430.778132:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88918356f800 x1875174015136768/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.778142:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136768:0@lo:5: 00000004:00080000:1.0:1788305430.778149:0:8751:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788305430.778173:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136896:0@lo:5: 00000100:00100000:1.0:1788305430.778196:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.778217:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305430.778580:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015136896 00000100:00100000:2.0:1788305430.778586:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015136896 00000100:00100000:2.0:1788305430.778622:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305430.778630:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8751:x1875174015136896:12345-0@lo:5: 00002000:00080000:2.0:1788305430.778656:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788305430.781426:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8751:x1875174015136896:12345-0@lo:5: Request processed in 2788us (3220us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788305430.781440:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788305430.781855:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ed80 x1875174015136896/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305430.781874:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8751:1875174015136896:0@lo:5: 00000004:00080000:1.0:1788305430.781888:0:8751:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1788305430.781934:0:8751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8751:1875174015137024:0@lo:900: 00000100:00100000:1.0:1788305430.781966:0:8751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305430.781995:0:8751:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305430.782184:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137024 00000100:00100000:0.0:1788305430.782192:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137024 00000100:00100000:0.0:1788305430.782239:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305430.782248:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8751:x1875174015137024:12345-0@lo:900: 00000100:00100000:0.0:1788305430.782318:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8751:x1875174015137024:12345-0@lo:900: Request processed in 71us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305430.782324:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788305430.782350:0:8751:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88908209ca80 x1875174015137024/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305446 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305430.782359:0:8751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8751:1875174015137024:0@lo:900: 00000001:02000400:3.0:1788305431.615578:0:8812:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305431.637489:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305432.666633:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305432.990617:0:8864:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305432.990849:0:8864:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788305433.048792:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305433.048819:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015137152:0@lo:41: 00000100:00100000:0.0:1788305433.048912:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305433.048980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137152 00000100:00100000:0.0:1788305433.048988:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137152 00000100:00100000:0.0:1788305433.049035:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305433.049045:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015137152:12345-0@lo:41: 00000004:00000024:0.0:1788305433.049078:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788305433.049120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015137152:12345-0@lo:41: Request processed in 76us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305433.049127:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305433.049173:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015137152:0@lo:41: 00000100:00100000:0.0:1788305433.050480:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305433.050500:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015137280:0@lo:41: 00000100:00100000:0.0:1788305433.050560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305433.050602:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137280 00000100:00100000:0.0:1788305433.050607:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137280 00000100:00100000:0.0:1788305433.050638:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305433.050646:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015137280:12345-0@lo:41: 00000004:00000024:0.0:1788305433.050672:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788305433.050719:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015137280:12345-0@lo:41: Request processed in 73us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305433.050725:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305433.050762:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015137280:0@lo:41: 00010000:00010000:2.0:1788305433.686388:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788305434.057094:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1788305434.057111:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788305434.709771:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305435.734239:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305436.118533:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015137536:0@lo:400: 00000100:00100000:3.0:1788305436.118633:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305436.119457:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015137792:0@lo:400: 00000100:00100000:0.0:1788305436.119458:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015137408:0@lo:400: 00000100:00100000:3.0:1788305436.119601:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015138048:0@lo:400: 00000100:00100000:1.0:1788305436.123121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305436.123219:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015138304:0@lo:400: 00000100:00100000:1.0:1788305436.123305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305436.123381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137536 00000100:00100000:1.0:1788305436.123391:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137536 00000100:00100000:1.0:1788305436.123445:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137792 00000100:00100000:1.0:1788305436.123449:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137792 00000100:00100000:1.0:1788305436.123468:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305436.123478:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015137536:12345-0@lo:400: 00000100:00100000:1.0:1788305436.123545:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015137536:12345-0@lo:400: Request processed in 67us (4913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305436.123554:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305436.123569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305436.123578:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305436.123586:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015137792:12345-0@lo:400: 00000100:00100000:0.0:1788305436.123626:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015137920:0@lo:400: 00000100:00100000:1.0:1788305436.123630:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015137792:12345-0@lo:400: Request processed in 43us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305436.123636:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305436.123690:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.123713:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015138432:0@lo:400: 00000100:00100000:0.0:1788305436.123736:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.123817:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137920 00000100:00100000:0.0:1788305436.123821:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137920 00000100:00100000:1.0:1788305436.123833:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138304 00000100:00100000:1.0:1788305436.123839:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138304 00000100:00100000:0.0:1788305436.123858:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305436.123869:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015137920:12345-0@lo:400: 00000100:00100000:1.0:1788305436.123882:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138432 00000100:00100000:1.0:1788305436.123887:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138432 00000100:00100000:1.0:1788305436.123921:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305436.123922:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015137920:12345-0@lo:400: Request processed in 52us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305436.123933:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015138304:12345-0@lo:400: 00000100:00100000:0.0:1788305436.123933:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788305436.123981:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015138304:12345-0@lo:400: Request processed in 50us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.123989:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015137920:0@lo:400: 00010000:00080000:0.0:1788305436.124068:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fdf80 x1875174015137792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.124081:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015137792:0@lo:400: 00010000:00080000:0.0:1788305436.124090:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826ffb80 x1875174015138304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.124098:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788305436.124110:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015138304:0@lo:400: 00000100:00100000:0.0:1788305436.124144:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305436.124163:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137408 00000100:00100000:3.0:1788305436.124168:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137408 00000100:00100000:3.0:1788305436.124202:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788305436.124210:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015137408:12345-0@lo:400: 00000100:00100000:3.0:1788305436.124257:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015137408:12345-0@lo:400: Request processed in 48us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305436.124265:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788305436.124325:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015137664:0@lo:400: 00000100:00100000:3.0:1788305436.124355:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305436.124377:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015138176:0@lo:400: 00000100:00100000:3.0:1788305436.124409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305436.124429:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015138688:0@lo:13: 00000100:00100000:3.0:1788305436.124453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305436.124485:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305436.124492:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015138560:0@lo:13: 00000100:00100000:3.0:1788305436.124541:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.124631:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015138432:12345-0@lo:400: 00000100:00100000:0.0:1788305436.124665:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015138432:12345-0@lo:400: Request processed in 515us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.124682:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788305436.124704:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305436.124726:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015137408:0@lo:400: 00010000:00080000:0.0:1788305436.124744:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fc380 x1875174015138432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.124753:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788305436.124766:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015138432:0@lo:400: 00000100:00100000:0.0:1788305436.124806:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138176 00000100:00100000:0.0:1788305436.124810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138176 00000100:00100000:0.0:1788305436.124840:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305436.124848:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015138176:12345-0@lo:400: 00000100:00100000:0.0:1788305436.124884:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015138176:12345-0@lo:400: Request processed in 37us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.124890:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788305436.124905:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305436.124941:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138688 00000100:00100000:0.0:1788305436.124945:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138688 00000100:00100000:0.0:1788305436.124962:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138560 00000100:00100000:0.0:1788305436.124964:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138560 00000100:00100000:0.0:1788305436.124977:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305436.124984:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015138688:12345-0@lo:13: 00002000:00000024:0.0:1788305436.125020:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305436.125056:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015138688:12345-0@lo:13: Request processed in 72us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.125062:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305436.125073:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305436.125078:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015138560:12345-0@lo:13: 00002000:00000024:0.0:1788305436.125086:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305436.125106:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015138560:12345-0@lo:13: Request processed in 28us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.125118:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305436.125138:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015137664 00000100:00100000:0.0:1788305436.125141:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015137664 00000100:00100000:1.0:1788305436.127135:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788305436.127490:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082051880 x1875174015138560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305436.127520:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015138560:0@lo:13: 00010000:00080000:3.0:1788305436.127536:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fc700 x1875174015138176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305436.127546:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015138176:0@lo:400: 00010000:00080000:3.0:1788305436.127561:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184027b80 x1875174015138688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305436.127572:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015138688:0@lo:13: 00000100:00100000:0.0:1788305436.128591:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305436.128616:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015137664:12345-0@lo:400: 00000100:00100000:0.0:1788305436.128744:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015137664:12345-0@lo:400: Request processed in 141us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.128751:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305436.128808:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305436.128844:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138048 00000100:00100000:3.0:1788305436.128851:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015137664:0@lo:400: 00000100:00100000:0.0:1788305436.128853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138048 00000100:00100000:0.0:1788305436.128916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305436.128923:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015138048:12345-0@lo:400: 00000100:00100000:0.0:1788305436.128958:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015138048:12345-0@lo:400: Request processed in 36us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305436.128965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788305436.128981:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305436.129003:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826ff100 x1875174015138048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.129015:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015138048:0@lo:400: 00010000:00080000:0.0:1788305436.129041:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fd180 x1875174015137536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305452 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305436.129050:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015137536:0@lo:400: 00000020:00000004:3.0:1788305436.185838:0:8966:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305436.186098:0:8966:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305436.758577:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788305437.418144:0:9014:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305437.418157:0:9014:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788305437.789706:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305438.166138:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305438.166175:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015138816:0@lo:41: 00000100:00100000:2.0:1788305438.166339:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305438.166514:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138816 00000100:00100000:0.0:1788305438.166547:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138816 00000100:00100000:0.0:1788305438.166617:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305438.166629:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015138816:12345-0@lo:41: 00000004:00000024:0.0:1788305438.166688:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788305438.166757:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015138816:12345-0@lo:41: Request processed in 130us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305438.166766:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305438.167026:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015138816:0@lo:41: 00000100:00100000:2.0:1788305438.168301:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015138944:0@lo:41: 00000100:00100000:2.0:1788305438.168400:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305438.168857:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015138944 00000100:00100000:0.0:1788305438.168867:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015138944 00000100:00100000:0.0:1788305438.168930:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305438.168947:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015138944:12345-0@lo:41: 00000004:00000024:0.0:1788305438.168986:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788305438.169049:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015138944:12345-0@lo:41: Request processed in 104us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305438.169054:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305438.169161:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015138944:0@lo:41: 00010000:00010000:0.0:1788305438.823730:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305439.844985:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305440.863145:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305441.243804:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015139072:0@lo:400: 00000100:00100000:3.0:1788305441.243909:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.243965:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015139584:0@lo:400: 00000100:00100000:3.0:1788305441.243992:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244013:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015140096:0@lo:400: 00000100:00100000:3.0:1788305441.244038:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244068:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305441.244074:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015139200:0@lo:400: 00000100:00100000:3.0:1788305441.244126:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244147:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015139712:0@lo:400: 00000100:00100000:3.0:1788305441.244169:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244201:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015139328:0@lo:400: 00000100:00100000:3.0:1788305441.244268:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244318:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015139840:0@lo:400: 00000100:00100000:3.0:1788305441.244344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244364:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305441.244369:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015139456:0@lo:400: 00000100:00100000:3.0:1788305441.244391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244402:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015139968:0@lo:400: 00000100:00100000:3.0:1788305441.244423:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305441.244461:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139072 00000100:00100000:3.0:1788305441.244470:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139072 00000100:00100000:3.0:1788305441.244524:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788305441.244533:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015139072:12345-0@lo:400: 00000100:00100000:3.0:1788305441.244586:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015139072:12345-0@lo:400: Request processed in 54us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.244594:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788305441.244641:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139584 00000100:00100000:3.0:1788305441.244645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139584 00000100:00100000:3.0:1788305441.244668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139328 00000100:00100000:3.0:1788305441.244670:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139328 00000100:00100000:3.0:1788305441.244683:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305441.244689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015139584:12345-0@lo:400: 00000100:00100000:3.0:1788305441.244722:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015139584:12345-0@lo:400: Request processed in 33us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.244734:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305441.244746:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305441.244751:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015139328:12345-0@lo:400: 00000100:00100000:3.0:1788305441.244778:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015139328:12345-0@lo:400: Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.244783:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305441.244800:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140096 00000100:00100000:3.0:1788305441.244803:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140096 00000100:00100000:3.0:1788305441.244836:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139968 00000100:00100000:3.0:1788305441.244838:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139968 00000100:00100000:3.0:1788305441.244855:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305441.244861:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015140096:12345-0@lo:400: 00000100:00100000:3.0:1788305441.244886:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015140096:12345-0@lo:400: Request processed in 26us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.244892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305441.244901:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305441.244905:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015139968:12345-0@lo:400: 00000100:00100000:3.0:1788305441.244926:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015139968:12345-0@lo:400: Request processed in 20us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.244931:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305441.244947:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139200 00000100:00100000:3.0:1788305441.244949:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139200 00000100:00100000:3.0:1788305441.244963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139712 00000100:00100000:3.0:1788305441.244965:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139712 00000100:00100000:3.0:1788305441.244975:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139840 00000100:00100000:3.0:1788305441.244978:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139840 00000100:00100000:3.0:1788305441.244987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015139456 00000100:00100000:3.0:1788305441.244989:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015139456 00000100:00100000:3.0:1788305441.245008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305441.245013:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015139200:12345-0@lo:400: 00000100:00100000:3.0:1788305441.245043:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015139200:12345-0@lo:400: Request processed in 30us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.245050:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305441.245061:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305441.245067:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015139712:12345-0@lo:400: 00000100:00100000:3.0:1788305441.245094:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015139712:12345-0@lo:400: Request processed in 28us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.245100:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305441.245111:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305441.245118:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015139840:12345-0@lo:400: 00000100:00100000:3.0:1788305441.245159:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015139840:12345-0@lo:400: Request processed in 41us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.245165:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305441.245177:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788305441.245183:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015139456:12345-0@lo:400: 00000100:00100000:3.0:1788305441.245208:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015139456:12345-0@lo:400: Request processed in 26us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305441.245214:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788305441.245296:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fc700 x1875174015139200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245314:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015139200:0@lo:400: 00010000:00080000:3.0:1788305441.245328:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fd180 x1875174015139712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245350:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015139712:0@lo:400: 00000100:00100000:3.0:1788305441.245363:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015139072:0@lo:400: 00000100:00100000:3.0:1788305441.245374:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015139584:0@lo:400: 00010000:00080000:3.0:1788305441.245383:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826ff800 x1875174015140096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245390:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015140096:0@lo:400: 00010000:00080000:3.0:1788305441.245435:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fd880 x1875174015139456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245444:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015139456:0@lo:400: 00010000:00080000:3.0:1788305441.245455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826fc380 x1875174015139968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245462:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015139968:0@lo:400: 00000100:00100000:3.0:1788305441.245471:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015139328:0@lo:400: 00010000:00080000:3.0:1788305441.245482:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890826ff100 x1875174015139840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305441.245489:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015139840:0@lo:400: 00000100:00080000:3.0:1788305441.245512:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305441.245517:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305441.245520:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305441.254901:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015140224:0@lo:13: 00000100:00100000:3.0:1788305441.255019:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305441.255590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015140352:0@lo:13: 00000100:00100000:2.0:1788305441.258343:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305441.270411:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140224 00000100:00100000:1.0:1788305441.270434:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140224 00000100:00100000:1.0:1788305441.270515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140352 00000100:00100000:1.0:1788305441.270520:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140352 00000100:00100000:1.0:1788305441.270541:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305441.270553:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015140224:12345-0@lo:13: 00002000:00000024:1.0:1788305441.270595:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305441.271430:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015140224:12345-0@lo:13: Request processed in 872us (16404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305441.271442:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305441.271474:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305441.271484:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015140352:12345-0@lo:13: 00002000:00000024:1.0:1788305441.271500:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305441.271554:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015140352:12345-0@lo:13: Request processed in 73us (13223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305441.271561:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788305441.278058:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082050700 x1875174015140224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.278097:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015140224:0@lo:13: 00010000:00080000:2.0:1788305441.278158:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff88918356d500 x1875174015140352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305441.278174:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015140352:0@lo:13: 00010000:00010000:0.0:1788305441.880236:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305442.910978:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305443.287407:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015140480:0@lo:41: 00000100:00100000:3.0:1788305443.287507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305443.287632:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140480 00000100:00100000:3.0:1788305443.287642:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140480 00000100:00100000:3.0:1788305443.287715:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305443.287727:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015140480:12345-0@lo:41: 00000004:00000024:3.0:1788305443.288183:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788305443.288250:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015140480:12345-0@lo:41: Request processed in 524us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305443.288259:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305443.288336:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015140480:0@lo:41: 00000100:00100000:1.0:1788305443.291054:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015140608:0@lo:41: 00000100:00100000:1.0:1788305443.291148:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305443.291224:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140608 00000100:00100000:3.0:1788305443.291233:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140608 00000100:00100000:3.0:1788305443.291317:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305443.291328:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015140608:12345-0@lo:41: 00000004:00000024:3.0:1788305443.291445:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788305443.291501:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015140608:12345-0@lo:41: Request processed in 174us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305443.291509:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305443.293913:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015140608:0@lo:41: 00010000:00010000:2.0:1788305443.936877:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305444.955311:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305445.984129:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305446.357659:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015140736:0@lo:13: 00000100:00100000:2.0:1788305446.357734:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305446.357804:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140736 00000100:00100000:2.0:1788305446.357812:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140736 00000100:00100000:2.0:1788305446.357866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305446.357944:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015140736:12345-0@lo:13: 00002000:00000024:2.0:1788305446.357973:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305446.358016:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015140736:12345-0@lo:13: Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305446.358023:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788305446.358044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305446.358070:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26bb80 x1875174015140736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305446.358089:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015140736:0@lo:13: 00000100:00100000:3.0:1788305446.359626:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015140864:0@lo:400: 00000100:00100000:3.0:1788305446.359685:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.359966:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305446.359975:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015140992:0@lo:400: 00000100:00100000:3.0:1788305446.360007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.360044:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140992 00000100:00100000:3.0:1788305446.360050:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140992 00000100:00100000:3.0:1788305446.360090:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305446.360104:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015140992:12345-0@lo:400: 00000100:00100000:3.0:1788305446.360153:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015140992:12345-0@lo:400: Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305446.360166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788305446.360216:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024380 x1875174015140992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305446.360230:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015140992:0@lo:400: 00000100:00100000:3.0:1788305446.360534:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015141120:0@lo:400: 00000100:00100000:3.0:1788305446.360567:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.360712:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305446.360720:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015141248:0@lo:400: 00000100:00100000:3.0:1788305446.360746:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.360772:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141120 00000100:00100000:3.0:1788305446.360777:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141120 00000100:00100000:3.0:1788305446.360805:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305446.360812:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015141120:12345-0@lo:400: 00000100:00100000:3.0:1788305446.360850:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015141120:12345-0@lo:400: Request processed in 39us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305446.360856:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305446.360873:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141248 00000100:00100000:3.0:1788305446.360877:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141248 00000100:00100000:3.0:1788305446.360896:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305446.360901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015141248:12345-0@lo:400: 00000100:00100000:3.0:1788305446.360928:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015141248:12345-0@lo:400: Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305446.360933:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788305446.360972:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024380 x1875174015141248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305446.360982:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015141248:0@lo:400: 00000100:00100000:3.0:1788305446.360991:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015141120:0@lo:400: 00000100:00100000:3.0:1788305446.361101:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015141376:0@lo:400: 00000100:00100000:3.0:1788305446.361126:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.361251:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305446.361259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015141504:0@lo:400: 00000100:00100000:3.0:1788305446.361305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305446.361329:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141504 00000100:00100000:3.0:1788305446.361333:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141504 00000100:00100000:3.0:1788305446.361364:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305446.361371:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015141504:12345-0@lo:400: 00000100:00100000:3.0:1788305446.361405:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015141504:12345-0@lo:400: Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305446.361410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788305446.361546:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305446.361638:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015140864 00000100:00100000:1.0:1788305446.361643:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015140864 00000100:00100000:1.0:1788305446.361674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788305446.361681:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:3647:x1875174015140864:12345-0@lo:400: 00000100:00100000:1.0:1788305446.361715:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:3647:x1875174015140864:12345-0@lo:400: Request processed in 36us (2031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305446.361722:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788305446.361755:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015141760:0@lo:400: 00000100:00100000:1.0:1788305446.361794:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305446.361814:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305446.361820:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015141632:0@lo:400: 00000100:00100000:1.0:1788305446.361841:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305446.361865:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141376 00000100:00100000:1.0:1788305446.361868:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141376 00000100:00100000:1.0:1788305446.361891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788305446.361897:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015141376:12345-0@lo:400: 00000100:00100000:1.0:1788305446.361926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015141376:12345-0@lo:400: Request processed in 30us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305446.361933:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788305446.361954:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141760 00000100:00100000:1.0:1788305446.361958:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141760 00000100:00100000:1.0:1788305446.361987:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305446.361994:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015141760:12345-0@lo:400: 00000100:00100000:1.0:1788305446.362026:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015141760:12345-0@lo:400: Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305446.362032:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788305446.362063:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb357480 x1875174015141760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305446.362075:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015141760:0@lo:400: 00000100:00100000:1.0:1788305446.362095:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141632 00000100:00100000:1.0:1788305446.362099:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141632 00000100:00100000:1.0:1788305446.362123:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305446.362129:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015141632:12345-0@lo:400: 00000100:00100000:1.0:1788305446.362161:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015141632:12345-0@lo:400: Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305446.362348:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788305446.362375:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024380 x1875174015141632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305446.362385:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015141632:0@lo:400: 00000100:00080000:3.0:1788305446.362787:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305446.362792:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305446.362824:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184025880 x1875174015141504/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305446.362834:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015141504:0@lo:400: 00000100:00100000:3.0:1788305446.362846:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015141376:0@lo:400: 00000100:00100000:3.0:1788305446.362855:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015140864:0@lo:400: 00000100:00100000:3.0:1788305446.365459:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015141888:0@lo:13: 00000100:00100000:3.0:1788305446.365537:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305446.365779:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015141888 00000100:00100000:1.0:1788305446.365787:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015141888 00000100:00100000:1.0:1788305446.365833:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305446.365842:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015141888:12345-0@lo:13: 00002000:00000024:1.0:1788305446.365866:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305446.370054:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015141888:12345-0@lo:13: Request processed in 4201us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305446.370069:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788305446.371680:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889082051180 x1875174015141888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305446.371709:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015141888:0@lo:13: 00010000:00010000:1.0:1788305447.008881:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305448.021900:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305448.405510:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015142016:0@lo:41: 00000100:00100000:2.0:1788305448.405641:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305448.411461:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142016 00000100:00100000:2.0:1788305448.411482:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142016 00000100:00100000:2.0:1788305448.411593:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305448.411608:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015142016:12345-0@lo:41: 00000004:00000024:2.0:1788305448.411660:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788305448.411780:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015142016:12345-0@lo:41: Request processed in 176us (6139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305448.411788:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305448.411861:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015142016:0@lo:41: 00000100:00100000:2.0:1788305448.417111:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015142144:0@lo:41: 00000100:00100000:2.0:1788305448.417236:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305448.417441:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142144 00000100:00100000:1.0:1788305448.417453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142144 00000100:00100000:1.0:1788305448.417513:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305448.417526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015142144:12345-0@lo:41: 00000004:00000024:1.0:1788305448.417702:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788305448.417779:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015142144:12345-0@lo:41: Request processed in 256us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305448.417788:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305448.417885:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015142144:0@lo:41: 00010000:00010000:3.0:1788305449.046681:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305450.069439:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.093613:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788305451.144324:0:9514:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305451.144328:0:9514:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788305451.144330:0:9514:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788305451.144459:0:9514:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889082750000 00000020:01000004:3.0:1788305451.144476:0:9514:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788305451.144493:0:9514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788305451.144507:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8891b8fa19b8) 00000020:00000080:3.0:1788305451.144524:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788305451.221659:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788305451.221734:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788305451.255564:0:9514:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788305451.255781:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788305451.255796:0:9514:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788305451.255807:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e605335a 00000020:01000004:3.0:1788305451.255813:0:9514:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788305451.255834:0:9514:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788305451.255837:0:9514:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788305451.255844:0:9514:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788305451.255872:0:9514:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788305451.255876:0:9514:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788305451.277261:0:9514:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305451.278252:0:9514:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788305451.278260:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305451.278262:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788305451.278263:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305451.278264:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305451.278265:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305451.278267:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305451.278268:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305451.278270:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305451.278557:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305451.278558:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305451.278560:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305451.278564:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788305451.278567:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305451.278568:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788305451.278569:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305451.278570:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305451.278571:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305451.278572:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305451.278573:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305451.278574:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788305451.278575:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788305451.278575:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305451.278576:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305451.278608:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788305451.278628:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015142272:0@lo:253: 00000100:00100000:0.0:1788305451.278709:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.278762:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186dc4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.278798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142272 00000100:00100000:3.0:1788305451.278807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142272 00000100:00100000:3.0:1788305451.278854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788305451.278864:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:9514:x1875174015142272:12345-0@lo:253: 20000000:01000000:3.0:1788305451.278904:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788305451.278913:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788305451.278917:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788305451.278920:0:6514:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788305451.279181:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305451.279596:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788305451.279617:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788305451.279634:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788305451.279639:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788305451.279651:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788305451.279666:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788305451.279755:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788305451.279770:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:3.0:1788305451.279772:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788305451.281718:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788305451.281750:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305451.281963:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788305451.281973:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:3.0:1788305451.281992:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788305451.281999:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788305451.282011:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788305451.282027:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788305451.282556:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788305451.282577:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:3.0:1788305451.282580:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788305451.282595:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788305451.282600:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788305451.282614:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788305451.282620:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:3.0:1788305451.282655:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788305451.282663:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788305451.282675:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788305451.282699:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788305451.283254:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788305451.283269:0:6514:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.155@tcp 20000000:01000000:3.0:1788305451.283271:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.155@tcp (null) (null) (null) 00000040:00080000:3.0:1788305451.283381:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788305451.283389:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788305451.283403:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788305451.283409:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.155@tcp (null) (null) 00000040:00080000:3.0:1788305451.283421:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788305451.283427:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788305451.283441:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788305451.283457:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788305451.283469:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788305451.283472:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788305451.283476:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788305451.283521:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788305451.283523:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788305451.285488:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788305451.285534:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788305451.285564:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788305451.285844:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788305451.285868:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788305451.285883:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788305451.285893:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788305451.285896:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788305451.286256:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1788305451.286440:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1788305451.286461:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788305451.286631:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788305451.286650:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788305451.286665:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788305451.286672:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788305451.286675:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788305451.286964:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788305451.286990:0:9522:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788305451.287000:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788305451.287483:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788305451.287521:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788305451.287551:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788305451.287563:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788305451.287565:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788305451.287898:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788305451.287926:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788305451.287941:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788305451.288091:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788305451.288112:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788305451.288208:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788305451.288220:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788305451.288222:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788305451.288598:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788305451.288722:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788305451.288753:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788305451.288769:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:1.0:1788305451.288784:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788305451.288805:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288822:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288830:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605327a expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288837:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532b9 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288844:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532d5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288850:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532ff expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288857:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605331b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288864:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288871:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288910:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.288934:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.288950:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142400:0@lo:104: 00000100:00100000:1.0:1788305451.289020:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305451.289110:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605331b expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.289130:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605331b expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.289138:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142528:0@lo:104: 00000100:00100000:1.0:1788305451.289163:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305451.289886:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.289897:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.289907:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142656:0@lo:104: 00000100:00100000:0.0:1788305451.289949:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305451.289968:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142400 00000100:00100000:3.0:1788305451.289975:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142400 00000100:00100000:2.0:1788305451.290027:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142528 00000100:00100000:2.0:1788305451.290032:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142528 00000100:00100000:2.0:1788305451.290057:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305451.290066:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015142400:12345-0@lo:104: 00010000:00010000:2.0:1788305451.290078:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290205:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305451.290211:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015142400:12345-0@lo:104: Request processed in 147us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.290219:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305451.290244:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305451.290251:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015142528:12345-0@lo:104: 00010000:00010000:2.0:1788305451.290258:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290334:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305451.290340:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015142528:12345-0@lo:104: Request processed in 90us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.290346:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1788305451.290365:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305451.290370:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290378:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.290381:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290389:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.290396:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.290401:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.290428:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290434:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.290451:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290468:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605333e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605334c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290481:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305451.290485:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290492:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.290495:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290502:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.290508:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.290512:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.290526:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290532:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.290557:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290564:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181682e00/0x4a426866e605331b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053322 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290572:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.290579:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.290581:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305451.290596:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015142784:0@lo:103: 00000100:00100000:2.0:1788305451.290627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.290665:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015142912:0@lo:103: 00000100:00100000:2.0:1788305451.290687:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.290719:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142784 00000100:00100000:2.0:1788305451.290723:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142784 00010000:00010000:2.0:1788305451.290740:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605333e expref: 22 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.290758:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142912 00000100:00100000:2.0:1788305451.290761:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142912 00010000:00010000:2.0:1788305451.290773:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605331b expref: 23 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.290790:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305451.290797:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+23:3650:x1875174015142784:12345-0@lo:103: 00010000:00010000:2.0:1788305451.290807:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.290812:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605333e expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290822:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605333e expref: 23 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290838:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.290865:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+23:3650:x1875174015142784:12345-0@lo:103: Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.290871:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305451.290884:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305451.290898:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+22:3647:x1875174015142912:12345-0@lo:103: 00010000:00010000:2.0:1788305451.290905:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.290910:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605331b expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290918:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605331b expref: 22 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.290927:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.290954:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+22:3647:x1875174015142912:12345-0@lo:103: Request processed in 57us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.290960:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305451.291001:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015142912:0@lo:103: 00000100:00100000:2.0:1788305451.291026:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015142784:0@lo:103: 00010000:00010000:0.0:1788305451.291340:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.291350:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291360:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143040:0@lo:104: 00000100:00100000:0.0:1788305451.291385:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305451.291406:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.291414:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291421:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143168:0@lo:104: 00000100:00100000:0.0:1788305451.291442:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305451.291461:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605327a expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.291468:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605327a expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291476:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143296:0@lo:104: 00000100:00100000:0.0:1788305451.291498:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305451.291514:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.291522:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291555:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143424:0@lo:104: 00000100:00100000:0.0:1788305451.291575:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d540 going to sleep for 11 seconds 00010000:00010000:0.0:1788305451.291589:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518600/0x4a426866e605334c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605333e expref: 21 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291599:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142400:0@lo:104: 00010000:00010000:0.0:1788305451.291607:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683200/0x4a426866e6053322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605331b expref: 20 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.291615:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142528:0@lo:104: 00010000:00010000:1.0:1788305451.291704:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305451.291761:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788305451.291778:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.291789:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015142656 00000100:00100000:2.0:1788305451.291793:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015142656 00000100:00100000:2.0:1788305451.291816:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143040 00000100:00100000:2.0:1788305451.291819:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143040 00000100:00100000:2.0:1788305451.291828:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143168 00000100:00100000:2.0:1788305451.291830:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143168 00000100:00100000:2.0:1788305451.291838:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143296 00000100:00100000:2.0:1788305451.291840:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143296 00000100:00100000:2.0:1788305451.291847:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143424 00000100:00100000:2.0:1788305451.291848:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143424 00000100:00100000:2.0:1788305451.291857:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305451.291863:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+7:6514:x1875174015142656:12345-0@lo:104: 00010000:00010000:2.0:1788305451.291872:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.291964:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305451.291969:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+7:6514:x1875174015142656:12345-0@lo:104: Request processed in 107us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.291976:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305451.291991:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305451.291997:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:6514:x1875174015143040:12345-0@lo:104: 00010000:00010000:2.0:1788305451.292004:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292036:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305451.292041:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:6514:x1875174015143040:12345-0@lo:104: Request processed in 46us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.292046:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305451.292057:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305451.292062:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:6514:x1875174015143168:12345-0@lo:104: 00010000:00010000:2.0:1788305451.292069:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292196:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788305451.292201:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:6514:x1875174015143168:12345-0@lo:104: Request processed in 139us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.292207:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305451.292220:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305451.292226:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bd780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015143296:12345-0@lo:104: 00010000:00010000:2.0:1788305451.292234:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292267:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788305451.292295:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bd780c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6514:x1875174015143296:12345-0@lo:104: Request processed in 47us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.292303:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305451.292340:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305451.292348:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015143424:12345-0@lo:104: 00010000:00010000:2.0:1788305451.292354:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292381:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788305451.292385:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6514:x1875174015143424:12345-0@lo:104: Request processed in 40us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.292390:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788305451.292408:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788305451.292413:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292419:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181667400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.292422:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292431:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.292438:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.292443:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.292472:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292479:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.292494:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292500:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181667400/0x4a426866e60532ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053306 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292512:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788305451.292515:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292519:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181666200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.292522:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292527:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.292532:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.292551:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.292564:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292569:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.292580:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292596:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181666200/0x4a426866e60532d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532dc expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292605:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788305451.292607:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292613:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.292615:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292621:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.292628:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.292633:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.292646:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292653:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.292659:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292665:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181682000/0x4a426866e60532b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532c0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292673:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305451.292683:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292689:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.292691:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292697:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.292703:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.292707:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.292722:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292727:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.292732:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292737:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e605327a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053281 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292745:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305451.292747:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292752:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.292755:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292771:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305451.292776:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305451.292781:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.292794:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292800:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305451.292804:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292810:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519800/0x4a426866e6053250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053257 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.292823:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.292825:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.292827:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305451.292842:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015143552:0@lo:103: 00000100:00100000:2.0:1788305451.292873:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.292891:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015144064:0@lo:103: 00000100:00100000:2.0:1788305451.292913:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.292931:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305451.292936:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015143936:0@lo:103: 00000100:00100000:2.0:1788305451.292957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.292983:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143552 00000100:00100000:2.0:1788305451.292995:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143552 00010000:00010000:2.0:1788305451.293014:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 20 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.293035:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144064 00000100:00100000:2.0:1788305451.293038:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144064 00010000:00010000:2.0:1788305451.293047:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.293056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143936 00000100:00100000:2.0:1788305451.293058:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143936 00010000:00010000:2.0:1788305451.293066:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605327a expref: 22 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.293076:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305451.293082:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+22:3648:x1875174015143552:12345-0@lo:103: 00010000:00010000:2.0:1788305451.293092:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.293098:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 22 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293107:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 22 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293394:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.293472:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+22:3648:x1875174015143552:12345-0@lo:103: Request processed in 389us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.293479:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305451.293493:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305451.293499:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015144064:12345-0@lo:103: 00010000:00010000:2.0:1788305451.293506:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.293516:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293525:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293543:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.293567:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015144064:12345-0@lo:103: Request processed in 69us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.293573:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305451.293608:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305451.293615:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+20:3648:x1875174015143936:12345-0@lo:103: 00010000:00010000:2.0:1788305451.293622:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.293627:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605327a expref: 20 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293635:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605327a expref: 20 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293645:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.293672:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:137eb269-2484-4047-a131-a502494b009f+20:3648:x1875174015143936:12345-0@lo:103: Request processed in 57us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.293678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305451.293703:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015143680:0@lo:103: 00000100:00100000:2.0:1788305451.293727:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.293754:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305451.293760:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015143808:0@lo:103: 00000100:00100000:2.0:1788305451.293779:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.293802:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143680 00000100:00100000:2.0:1788305451.293812:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143680 00010000:00010000:2.0:1788305451.293827:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 20 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.293839:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015143808 00000100:00100000:2.0:1788305451.293842:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015143808 00010000:00010000:2.0:1788305451.293851:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 21 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.293861:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305451.293866:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015143680:12345-0@lo:103: 00010000:00010000:2.0:1788305451.293873:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.293877:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293886:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 21 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293895:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.293922:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015143680:12345-0@lo:103: Request processed in 55us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.293928:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305451.293939:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305451.293946:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015143808:12345-0@lo:103: 00010000:00010000:2.0:1788305451.293953:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305451.293957:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 20 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293965:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 20 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293988:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.293996:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294009:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294017:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294023:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294029:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294034:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305451.294038:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294046:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294054:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.294063:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305451.294087:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015143808:12345-0@lo:103: Request processed in 142us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.294102:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788305451.294358:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305451.294387:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015143808:0@lo:103: 00000100:00100000:2.0:1788305451.294397:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015143680:0@lo:103: 00010000:00010000:1.0:1788305451.294500:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181667a00/0x4a426866e6053306 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60532ff expref: 19 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.294514:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015142656:0@lo:104: 00010000:00010000:1.0:1788305451.294523:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305451.294544:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181667c00/0x4a426866e60532dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60532d5 expref: 18 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.294554:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143040:0@lo:104: 00010000:00010000:1.0:1788305451.294564:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666a00/0x4a426866e60532c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60532b9 expref: 17 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.294572:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143168:0@lo:104: 00010000:00010000:1.0:1788305451.294580:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523b400/0x4a426866e6053281 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605327a expref: 16 pid: 6514 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.294597:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143296:0@lo:104: 00010000:00010000:1.0:1788305451.294608:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666600/0x4a426866e6053257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053250 expref: 15 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305451.294615:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6514:1875174015143424:0@lo:104: 00010000:00010000:1.0:1788305451.294641:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.294649:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.294655:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.294661:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889180031c00/0x4a426866e6053361 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305451.294675:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788305451.294795:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015143552:0@lo:103: 00000100:00100000:0.0:1788305451.294806:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015144064:0@lo:103: 00000100:00100000:0.0:1788305451.294821:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015143936:0@lo:103: 00000100:00100000:1.0:1788305451.297216:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+14:9514:x1875174015142272:12345-0@lo:253: Request processed in 18343us (18496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.297232:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788305451.297495:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015142272:0@lo:253: 10000000:01000000:2.0:1788305451.297513:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305451.297516:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305451.297518:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305451.297519:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305451.297521:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788305451.297522:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305451.297523:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305451.297525:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305451.297526:0:9514:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788305451.297528:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305451.297529:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788305451.297563:0:9514:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889082750000 from lustre-OST0001 10000000:01000000:2.0:1788305451.297595:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788305451.297598:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788305451.297608:0:9514:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff889186788000 local copy 10000000:01000000:2.0:1788305451.297613:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788305451.297651:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.297663:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.297673:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.297691:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144192:0@lo:101: 00000100:00100000:2.0:1788305451.297746:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.297786:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.297838:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144192 00000100:00100000:1.0:1788305451.297845:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144192 00000100:00100000:1.0:1788305451.297894:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788305451.297904:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+14:9514:x1875174015144192:12345-0@lo:101: 00010000:00010000:1.0:1788305451.297917:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305451.297930:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889180030a00/0x4a426866e605336f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053368 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.297966:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889180030a00/0x4a426866e605336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053368 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.297976:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889180030a00/0x4a426866e605336f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053368 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.297986:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180030a00, rc 0) 00000100:00100000:1.0:1788305451.298025:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144192:12345-0@lo:101: Request processed in 123us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.298031:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788305451.298534:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144192:0@lo:101: 00010000:00010000:3.0:1788305451.298564:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.298573:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305451.298686:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144320:0@lo:501: 00000100:00100000:3.0:1788305451.298722:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305451.298897:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.299353:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144320 00000100:00100000:1.0:1788305451.299360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144320 00000100:00100000:1.0:1788305451.299406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788305451.299464:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144320:12345-0@lo:501: 00000100:00100000:0.0:1788305451.299575:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144320:12345-0@lo:501: Request processed in 161us (851us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305451.299583:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788305451.299873:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144320:0@lo:501: 10000000:01000000:3.0:1788305451.299900:0:9514:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788305451.299916:0:9514:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788305451.299921:0:9514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.299929:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.299934:0:9514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.299949:0:9514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305451.299973:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305451.299979:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.299986:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305451.299991:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305451.299992:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889082750000 10000000:01000000:3.0:1788305451.299996:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305451.299999:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305451.300002:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788305451.300004:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:00010000:2.0:1788305451.300006:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305451.300009:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788305451.300011:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 10000000:01000000:2.0:1788305451.300013:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305451.300029:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.300035:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300035:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305451.300041:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.300049:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305451.300063:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144448:0@lo:101: 00010000:00010000:2.0:1788305451.300066:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300072:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb600/0x4a426866e6053368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4a426866e605336f expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300083:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.300085:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305451.300087:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305451.300094:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305451.300129:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305451.300141:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015144576:0@lo:103: 00000100:00100000:1.0:1788305451.300172:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305451.300217:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144576 00000100:00100000:1.0:1788305451.300222:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144576 00000100:00100000:1.0:1788305451.300257:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305451.300265:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+15:3650:x1875174015144576:12345-0@lo:103: 00010000:00010000:1.0:1788305451.300317:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305451.300333:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889180030a00/0x4a426866e605336f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053368 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.300349:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305451.300382:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+14:3650:x1875174015144576:12345-0@lo:103: Request processed in 118us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.300389:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305451.300393:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015144576:0@lo:103: 00000100:00100000:3.0:1788305451.300505:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825bacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305451.300507:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144448 00000100:00100000:2.0:1788305451.300517:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144448 00000100:00100000:2.0:1788305451.300562:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788305451.300569:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+14:9514:x1875174015144448:12345-0@lo:101: 00010000:00010000:2.0:1788305451.300579:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305451.300590:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053376 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300608:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053376 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300617:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053376 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.300625:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea200, rc 0) 00000100:00100000:2.0:1788305451.300664:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144448:12345-0@lo:101: Request processed in 96us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.300670:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788305451.300729:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144448:0@lo:101: 00010000:00010000:0.0:1788305451.300741:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.300750:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.300960:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144704:0@lo:501: 00000100:00100000:0.0:1788305451.300987:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.301016:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305451.301062:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144704 00000100:00100000:2.0:1788305451.301067:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144704 00000100:00100000:2.0:1788305451.301103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788305451.301109:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144704:12345-0@lo:501: 00000100:00100000:2.0:1788305451.301699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144704:12345-0@lo:501: Request processed in 587us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.301707:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788305451.301760:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144704:0@lo:501: 00000100:00100000:0.0:1788305451.301790:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144832:0@lo:503: 00000100:00100000:0.0:1788305451.301832:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.301863:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.301906:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144832 00000100:00100000:3.0:1788305451.301910:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144832 00000100:00100000:3.0:1788305451.301937:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788305451.301942:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144832:12345-0@lo:503: 00000100:00100000:3.0:1788305451.302009:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144832:12345-0@lo:503: Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.302016:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788305451.302034:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144832:0@lo:503: 00000040:00080000:0.0:1788305451.302533:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305451.302634:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144960:0@lo:502: 00000100:00100000:0.0:1788305451.302673:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.302738:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305451.302779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015144960 00000100:00100000:2.0:1788305451.302786:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015144960 00000100:00100000:2.0:1788305451.302820:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788305451.302828:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144960:12345-0@lo:502: 00000100:00100000:2.0:1788305451.302959:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015144960:12345-0@lo:502: Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.302973:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788305451.303034:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015144960:0@lo:502: 00000040:00080000:2.0:1788305451.303662:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788305451.303692:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788305451.303709:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788305451.303723:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788305451.303736:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788305451.303750:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788305451.303777:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145088:0@lo:502: 00000100:00100000:2.0:1788305451.303824:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.304018:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.305031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145088 00000100:00100000:1.0:1788305451.305042:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145088 00000100:00100000:1.0:1788305451.305108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788305451.305235:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015145088:12345-0@lo:502: 00000100:00100000:1.0:1788305451.305569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015145088:12345-0@lo:502: Request processed in 452us (1743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.305577:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788305451.305658:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145088:0@lo:502: 00000040:00080000:2.0:1788305451.305733:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788305451.305747:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788305451.306940:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305451.306950:0:9525:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788305451.306956:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.306958:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788305451.306964:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305451.306980:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff889186224d28) 00000020:00000080:0.0:1788305451.307005:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788305451.307012:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788305451.307179:0:9525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889082750000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788305451.307192:0:9525:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788305451.307199:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e605338b 00010000:00010000:2.0:1788305451.312079:0:9525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788305451.312587:0:9525:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788305451.315443:0:9525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788305451.315824:0:9525:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788305451.321065:0:9525:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788305451.321263:0:9525:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788305451.327862:0:9525:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788305451.329251:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788305451.329267:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305451.329321:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.329324:0:9525:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788305451.329328:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305451.329333:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.329335:0:9525:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788305451.329338:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788305451.329340:0:9525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788305451.329361:0:9525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305451.329364:0:9525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.329365:0:9525:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788305451.329367:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788305451.329688:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788305451.329719:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788305451.329743:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.329771:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305451.329780:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889082750000 from 1 10000000:01000000:3.0:1788305451.329783:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305451.329826:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.329834:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.329846:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305451.329872:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145216:0@lo:101: 00000100:00100000:3.0:1788305451.329946:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305451.329997:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.330097:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145216 00000100:00100000:1.0:1788305451.330106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145216 00000100:00100000:1.0:1788305451.330170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305451.330180:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015145216:12345-0@lo:101: 00010000:00010000:1.0:1788305451.330193:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305451.330205:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053392 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.330230:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053392 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.330239:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053392 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.330249:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180030a00, rc 0) 00000100:00100000:1.0:1788305451.330504:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145216:12345-0@lo:101: Request processed in 324us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.330511:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788305451.330614:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145216:0@lo:101: 00010000:00010000:3.0:1788305451.330629:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.330638:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305451.330741:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145344:0@lo:501: 00000100:00100000:3.0:1788305451.330772:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305451.330802:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.330875:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145344 00000100:00100000:1.0:1788305451.330880:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145344 00000100:00100000:1.0:1788305451.330913:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788305451.330921:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145344:12345-0@lo:501: 00000100:00100000:1.0:1788305451.331039:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145344:12345-0@lo:501: Request processed in 118us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.331047:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788305451.331080:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145344:0@lo:501: 00000100:00100000:1.0:1788305451.331108:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145472:0@lo:503: 00000100:00100000:1.0:1788305451.331431:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305451.331463:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.331591:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145472 00000100:00100000:3.0:1788305451.331597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145472 00000100:00100000:3.0:1788305451.331632:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788305451.331641:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145472:12345-0@lo:503: 00000100:00100000:3.0:1788305451.331745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145472:12345-0@lo:503: Request processed in 104us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.331751:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788305451.331834:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145472:0@lo:503: 00000040:00080000:0.0:1788305451.332100:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305451.332173:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145600:0@lo:502: 00000100:00100000:0.0:1788305451.332210:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.332233:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.332425:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145600 00000100:00100000:3.0:1788305451.332429:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145600 00000100:00100000:3.0:1788305451.332461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788305451.332468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145600:12345-0@lo:502: 00000100:00100000:3.0:1788305451.332559:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145600:12345-0@lo:502: Request processed in 91us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.332565:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788305451.332731:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145600:0@lo:502: 00000040:00080000:0.0:1788305451.332891:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788305451.332918:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788305451.332938:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145728:0@lo:502: 00000100:00100000:0.0:1788305451.332974:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.333007:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.333227:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145728 00000100:00100000:1.0:1788305451.333231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145728 00000100:00100000:1.0:1788305451.333261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788305451.333268:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145728:12345-0@lo:502: 00000100:00100000:1.0:1788305451.333425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145728:12345-0@lo:502: Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.333432:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788305451.333513:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145728:0@lo:502: 00000040:00080000:0.0:1788305451.333560:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788305451.333567:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788305451.334656:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305451.334668:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.334670:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788305451.334678:0:9528:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889082750000 00000020:00000080:0.0:1788305451.334690:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305451.334704:0:9528:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305451.334708:0:9528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305451.334709:0:9528:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788305451.334712:0:9528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788305451.338995:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788305451.339045:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305451.339069:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.339082:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305451.339231:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788305451.339236:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889082750000 10000000:01000000:0.0:1788305451.339239:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889082750000 10000000:01000000:0.0:1788305451.339244:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305451.339251:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889082750000 from 1 10000000:01000000:0.0:1788305451.339254:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305451.339430:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.339439:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.339449:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.339472:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145856:0@lo:101: 00000100:00100000:0.0:1788305451.339563:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.339611:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.339861:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145856 00000100:00100000:3.0:1788305451.339869:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145856 00000100:00100000:3.0:1788305451.339919:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788305451.339929:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9514:x1875174015145856:12345-0@lo:101: 00010000:00010000:3.0:1788305451.339942:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305451.339953:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60533a0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.339974:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60533a0 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.339984:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533a0 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.339993:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305451.340053:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015145856:12345-0@lo:101: Request processed in 125us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.340060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788305451.342681:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145856:0@lo:101: 00010000:00010000:0.0:1788305451.342715:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.342727:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.342889:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145984:0@lo:501: 00000100:00100000:0.0:1788305451.342963:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.343008:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.343102:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015145984 00000100:00100000:1.0:1788305451.343110:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015145984 00000100:00100000:1.0:1788305451.343174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788305451.343185:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015145984:12345-0@lo:501: 00000100:00100000:1.0:1788305451.343363:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015145984:12345-0@lo:501: Request processed in 179us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.343377:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305451.343567:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015145984:0@lo:501: 00000100:00100000:0.0:1788305451.343602:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146112:0@lo:503: 00000100:00100000:0.0:1788305451.343646:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.343670:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.343906:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146112 00000100:00100000:3.0:1788305451.343911:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146112 00000100:00100000:3.0:1788305451.343948:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788305451.343957:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146112:12345-0@lo:503: 00000100:00100000:3.0:1788305451.344047:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146112:12345-0@lo:503: Request processed in 91us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.344054:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788305451.344196:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146112:0@lo:503: 00000040:00080000:0.0:1788305451.344634:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305451.344714:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146240:0@lo:502: 00000100:00100000:0.0:1788305451.344762:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.344788:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.344855:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146240 00000100:00100000:3.0:1788305451.344864:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146240 00000100:00100000:3.0:1788305451.344897:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788305451.344905:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146240:12345-0@lo:502: 00000100:00100000:3.0:1788305451.344992:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146240:12345-0@lo:502: Request processed in 87us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.344999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788305451.345552:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146240:0@lo:502: 00000040:00080000:0.0:1788305451.345748:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788305451.345788:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788305451.345804:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788305451.345818:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788305451.345831:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788305451.345844:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788305451.345857:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788305451.345869:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788305451.345882:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788305451.345895:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788305451.345907:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788305451.345920:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788305451.345931:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788305451.345943:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788305451.345955:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788305451.345967:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788305451.345995:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788305451.346020:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788305451.346034:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788305451.346046:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788305451.346057:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788305451.346069:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788305451.346079:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788305451.346093:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788305451.346104:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788305451.346130:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788305451.346147:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788305451.346160:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788305451.346173:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788305451.346186:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788305451.346198:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788305451.346209:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788305451.346221:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788305451.346248:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788305451.346265:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788305451.346532:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788305451.346567:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788305451.346581:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788305451.346594:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788305451.346606:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788305451.346620:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788305451.346633:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:0.0:1788305451.346645:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:0.0:1788305451.346657:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:0.0:1788305451.346669:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:0.0:1788305451.346680:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:0.0:1788305451.346719:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146368:0@lo:502: 00000100:00100000:0.0:1788305451.346785:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.346831:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834efb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305451.348359:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146368 00000100:00100000:3.0:1788305451.348371:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146368 00000100:00100000:3.0:1788305451.348421:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788305451.348430:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146368:12345-0@lo:502: 00000100:00100000:3.0:1788305451.348598:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015146368:12345-0@lo:502: Request processed in 167us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.348605:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788305451.349039:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015146368:0@lo:502: 00000040:00080000:2.0:1788305451.349122:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788305451.349134:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788305451.350032:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788305451.350060:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8890833dcd28) 00000020:00000080:1.0:1788305451.350084:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788305451.350186:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889082750000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305451.350191:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889082750000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305451.350193:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889082750000 3 00010000:00080000:1.0:1788305451.350234:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88918448d000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305451.358015:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:1.0:1788305451.358435:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788305451.358484:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788305451.358502:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4a426866e60533b5 00000100:00080000:1.0:1788305451.358514:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305451.358520:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88918448d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305451.358571:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb354000 x1875174015146496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305451.358596:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788305451.358797:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015146496:0@lo:38: 00000100:00100000:0.0:1788305451.358873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.359233:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015146752:0@lo:400: 00000100:00100000:2.0:1788305451.359267:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.359327:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015147264:0@lo:400: 00000100:00100000:2.0:1788305451.359350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.359380:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788305451.359386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015146880:0@lo:400: 00000100:00100000:2.0:1788305451.359412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.359429:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015147392:0@lo:400: 00000100:00100000:2.0:1788305451.359453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.359482:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146496 00000100:00100000:2.0:1788305451.359489:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146496 00000100:00100000:2.0:1788305451.359512:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147264 00000100:00100000:2.0:1788305451.359514:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147264 00000100:00100000:2.0:1788305451.359567:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146880 00000100:00100000:2.0:1788305451.359571:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146880 00000100:00100000:2.0:1788305451.359589:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305451.359598:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015147264:12345-0@lo:400: 00000100:00100000:2.0:1788305451.359654:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015147264:12345-0@lo:400: Request processed in 57us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.359662:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305451.359678:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305451.359684:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015146880:12345-0@lo:400: 00000100:00100000:2.0:1788305451.359713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015146880:12345-0@lo:400: Request processed in 29us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.359719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788305451.359730:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305451.359734:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015146496:12345-0@lo:38: 00010000:00080000:2.0:1788305451.359754:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:2.0:1788305451.359797:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4a426866e60533bc 00000004:00100000:2.0:1788305451.359810:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788305451.359841:0:6521:0:(import.c:65:import_set_state_nolock()) ffff889082764800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305451.359889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875174015146496:12345-0@lo:38: Request processed in 153us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.359896:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305451.359916:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147392 00000100:00100000:2.0:1788305451.359920:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147392 00000100:00100000:2.0:1788305451.359948:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305451.359956:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015147392:12345-0@lo:400: 00000100:00100000:2.0:1788305451.359987:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015147392:12345-0@lo:400: Request processed in 32us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.359993:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788305451.360008:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305451.360012:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788305451.360040:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb269f80 x1875174015146880/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305451.360054:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015146880:0@lo:400: 00010000:00080000:2.0:1788305451.360066:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26b480 x1875174015147392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305451.360075:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015147392:0@lo:400: 00010000:00080000:2.0:1788305451.360085:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb269880 x1875174015147264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305451.360093:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015147264:0@lo:400: 00000100:00100000:0.0:1788305451.360272:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015146624:0@lo:400: 00000100:00100000:0.0:1788305451.360336:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.360356:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015147136:0@lo:400: 00000100:00100000:0.0:1788305451.360379:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.360394:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305451.360400:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015147008:0@lo:400: 00000100:00100000:0.0:1788305451.360423:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.360444:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015147520:0@lo:400: 00000100:00100000:0.0:1788305451.360466:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305451.360508:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb354000 x1875174015146496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.360517:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305451.360523:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788305451.360531:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788305451.360548:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788305451.360551:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788305451.360557:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015146496:0@lo:38: 00000100:00100000:0.0:1788305451.360579:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146752 00000100:00100000:0.0:1788305451.360583:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146752 00000100:00100000:0.0:1788305451.360630:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147008 00000100:00100000:0.0:1788305451.360633:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147008 00000100:00100000:0.0:1788305451.360648:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305451.360655:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015146752:12345-0@lo:400: 00000100:00100000:0.0:1788305451.360706:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015146752:12345-0@lo:400: Request processed in 51us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.360713:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305451.360727:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305451.360733:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015147008:12345-0@lo:400: 00000100:00100000:0.0:1788305451.360765:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015147008:12345-0@lo:400: Request processed in 32us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.360771:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305451.360789:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147520 00000100:00100000:0.0:1788305451.360793:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147520 00000100:00100000:0.0:1788305451.360822:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305451.360828:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015147520:12345-0@lo:400: 00000100:00100000:0.0:1788305451.360860:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015147520:12345-0@lo:400: Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.360866:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305451.360893:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015147008:0@lo:400: 00010000:00080000:0.0:1788305451.360902:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26a300 x1875174015147520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.360910:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015147520:0@lo:400: 00000100:00080000:0.0:1788305451.360930:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305451.360946:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015146752:0@lo:400: 00000100:00100000:2.0:1788305451.361556:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015146624 00000100:00100000:2.0:1788305451.361563:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015146624 00000100:00100000:2.0:1788305451.361584:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147136 00000100:00100000:2.0:1788305451.361587:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147136 00000100:00100000:2.0:1788305451.361614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305451.361620:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015146624:12345-0@lo:400: 00000100:00100000:2.0:1788305451.361673:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015146624:12345-0@lo:400: Request processed in 53us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.361680:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305451.361693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305451.361698:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015147136:12345-0@lo:400: 00000100:00100000:2.0:1788305451.361723:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015147136:12345-0@lo:400: Request processed in 26us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305451.361728:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000020:01000004:1.0:1788305451.361915:0:9530:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788305451.361931:0:9530:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8890833d99b8) 00000020:00000080:1.0:1788305451.361954:0:9530:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788305451.362031:0:9530:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889082750000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305451.362035:0:9530:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889082750000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788305451.362038:0:9530:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889082750000 3 00010000:00080000:1.0:1788305451.362068:0:9530:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bd78d000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00080000:0.0:1788305451.363665:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26b800 x1875174015146624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.363682:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015146624:0@lo:400: 00010000:00080000:0.0:1788305451.363693:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26b100 x1875174015147136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.363708:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015147136:0@lo:400: 00000100:00080000:0.0:1788305451.363755:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305451.363807:0:9531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1875174015147648:0@lo:901: 00000100:00100000:2.0:1788305451.363871:0:9531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.363907:0:9531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305451.364763:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147648 00000100:00100000:0.0:1788305451.364773:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147648 00000100:00100000:0.0:1788305451.364837:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305451.364848:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1875174015147648:12345-0@lo:901: 00000100:00100000:0.0:1788305451.364973:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9531:x1875174015147648:12345-0@lo:901: Request processed in 126us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.364981:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788305451.365004:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305451.365031:0:9531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb269500 x1875174015147648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788305467 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.365042:0:9531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269500 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9531:1875174015147648:0@lo:901: 00010000:00010000:1.0:1788305451.373651:0:9530:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788305451.373872:0:9530:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788305451.373919:0:9530:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788305451.373935:0:9530:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4a426866e60533ca 00000100:00080000:1.0:1788305451.373953:0:9530:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305451.373959:0:9530:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8891bd78d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305451.373999:0:9530:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb357100 x1875174015147776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305451.374074:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015147776:0@lo:38: 00000100:00100000:0.0:1788305451.374168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305451.375588:0:9530:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788305451.376872:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147776 00000100:00100000:1.0:1788305451.376886:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147776 00000100:00100000:1.0:1788305451.376941:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305451.376951:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015147776:12345-0@lo:38: 00010000:00080000:1.0:1788305451.376981:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 281 last 0 00000020:00000080:1.0:1788305451.377034:0:6521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4a426866e60533d1 00000004:00100000:1.0:1788305451.377051:0:6521:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305451.377088:0:6521:0:(import.c:65:import_set_state_nolock()) ffff889082739800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305451.388981:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875174015147776:12345-0@lo:38: Request processed in 11357us (14138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.389000:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:1.0:1788305451.389141:0:9530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788305451.389263:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788305451.389337:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305451.389352:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305451.389362:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788305451.389369:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb357100 x1875174015147776/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.389380:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305451.389390:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788305451.389397:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788305451.389402:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788305451.389405:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bd78d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000020:01000004:1.0:1788305451.389411:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:0.0:1788305451.389411:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015147776:0@lo:38: 00000020:01000004:1.0:1788305451.389414:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788305451.389415:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305451.389421:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305451.389422:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305451.389423:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305451.389425:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305451.389426:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305451.389427:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305451.389429:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305451.389430:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305451.389434:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788305451.389437:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305451.389438:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788305451.389439:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305451.389440:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305451.389440:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305451.389441:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305451.389442:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305451.389443:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788305451.389444:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788305451.389444:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305451.389445:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305451.389683:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788305451.389700:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015147904:0@lo:253: 00000100:00100000:1.0:1788305451.389768:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305451.389807:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305451.393362:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015147904 00000100:00100000:1.0:1788305451.393376:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015147904 00000100:00100000:1.0:1788305451.393439:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788305451.393450:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:9514:x1875174015147904:12345-0@lo:253: 20000000:01000000:1.0:1788305451.393485:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788305451.393500:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788305451.404312:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788305451.404343:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788305451.404720:0:6535:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305451.404726:0:6535:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305451.404750:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404770:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60532c7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404778:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605330d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404785:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404826:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605330d expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404840:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605330d expref: 17 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.404867:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015148032:0@lo:104: 00000100:00100000:2.0:1788305451.404936:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305451.404985:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.404994:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 17 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.405002:0:6535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015148160:0@lo:104: 00000100:00100000:2.0:1788305451.405024:0:6535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305451.405053:0:6535:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305451.405071:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148032 00000100:00100000:0.0:1788305451.405085:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148032 00000100:00100000:0.0:1788305451.405134:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148160 00000100:00100000:0.0:1788305451.405138:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148160 00000100:00100000:0.0:1788305451.405153:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305451.405161:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015148032:12345-0@lo:104: 00010000:00010000:0.0:1788305451.405173:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405246:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305451.405252:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:6535:x1875174015148032:12345-0@lo:104: Request processed in 93us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.405260:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305451.405261:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015148032:0@lo:104: 00000100:00100000:0.0:1788305451.405299:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305451.405306:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015148160:12345-0@lo:104: 00010000:00010000:0.0:1788305451.405314:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405362:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788305451.405365:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788305451.405368:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:6535:x1875174015148160:12345-0@lo:104: Request processed in 63us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1788305451.405372:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.405374:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788305451.405388:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305451.405390:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683000 already unused, calling callback (ffffffffc13b5c20) 00010000:00010000:0.0:1788305451.405392:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305451.405393:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405399:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181666c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305451.405401:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405402:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305451.405410:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305451.405416:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305451.405418:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305451.405423:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305451.405428:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305451.405442:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405448:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305451.405456:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405461:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305451.405465:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405471:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683000/0x4a426866e605330d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053314 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405472:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305451.405479:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181666c00/0x4a426866e60532c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60532ce expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305451.405484:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305451.405486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305451.405490:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305451.405491:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305451.405493:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305451.405503:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015148288:0@lo:103: 00000100:00100000:0.0:1788305451.405546:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.405589:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305451.405596:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015148416:0@lo:103: 00000100:00100000:0.0:1788305451.405618:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.405645:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148288 00000100:00100000:0.0:1788305451.405649:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148288 00000100:00100000:3.0:1788305451.405660:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148416 00000100:00100000:3.0:1788305451.405663:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148416 00010000:00010000:0.0:1788305451.405666:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605330d expref: 19 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405676:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 19 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305451.405795:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305451.405809:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+19:3648:x1875174015148416:12345-0@lo:103: 00010000:00010000:3.0:1788305451.405821:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305451.405827:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 19 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405837:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 19 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405852:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305451.405883:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+19:3648:x1875174015148416:12345-0@lo:103: Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.405889:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305451.405904:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788305451.405910:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+18:3650:x1875174015148288:12345-0@lo:103: 00010000:00010000:3.0:1788305451.405917:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305451.405922:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605330d expref: 18 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405930:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605330d expref: 18 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405939:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683600/0x4a426866e6053314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605330d expref: 18 pid: 6513 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405950:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405958:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305451.405981:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008352336s 00010000:00010000:3.0:1788305451.405986:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405993:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.405999:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.406001:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015148416:0@lo:103: 00010000:00010000:3.0:1788305451.406005:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.406010:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305451.406014:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.406021:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.406029:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305451.406038:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305451.406079:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+17:3650:x1875174015148288:12345-0@lo:103: Request processed in 169us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305451.406086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788305451.406147:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683400/0x4a426866e60532ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60532c7 expref: 16 pid: 6512 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305451.406157:0:6535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6535:1875174015148160:0@lo:104: 00010000:00010000:2.0:1788305451.406172:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.406181:0:6535:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.406187:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305451.406193:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb600/0x4a426866e60533d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305451.406309:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015148288:0@lo:103: 00000100:00100000:1.0:1788305451.407102:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:9514:x1875174015147904:12345-0@lo:253: Request processed in 13652us (17331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305451.407183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788305451.408257:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:137eb269-2484-4047-a131-a502494b009f:9514:1875174015147904:0@lo:253: 10000000:01000000:3.0:1788305451.408716:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788305451.408735:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305451.408736:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305451.408738:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305451.408739:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305451.408740:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305451.408741:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305451.408742:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305451.408744:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788305451.408745:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788305451.408747:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305451.408748:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788305451.408766:0:9514:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788305451.416560:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788305451.416743:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788305451.418161:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788305451.418448:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788305451.418712:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788305451.418943:0:9514:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788305451.423409:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788305451.445214:0:9514:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788305451.445226:0:9514:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788305451.445607:0:9514:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788305451.445656:0:9514:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788305451.445680:0:9514:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788305451.445703:0:9514:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788305451.453714:0:9514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305451.453931:0:9514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788305451.491587:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015148544:0@lo:13: 00000100:00100000:0.0:1788305451.491667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.491770:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015148672:0@lo:13: 00000100:00100000:0.0:1788305451.491797:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305451.491834:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148544 00000100:00100000:0.0:1788305451.491843:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148544 00000100:00100000:0.0:1788305451.491879:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148672 00000100:00100000:0.0:1788305451.491883:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148672 00000100:00100000:0.0:1788305451.491899:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305451.491908:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015148544:12345-0@lo:13: 00002000:00000024:0.0:1788305451.491938:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305451.491982:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015148544:12345-0@lo:13: Request processed in 74us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.491988:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305451.492005:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305451.492011:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015148672:12345-0@lo:13: 00002000:00000024:0.0:1788305451.492021:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305451.492049:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015148672:12345-0@lo:13: Request processed in 38us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305451.492054:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788305451.498784:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb26b480 x1875174015148544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.498833:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015148544:0@lo:13: 00010000:00080000:0.0:1788305451.498882:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8890836e0a80 x1875174015148672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305451.504614:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015148672:0@lo:13: 00010000:00010000:0.0:1788305452.118715:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305452.736730:0:9586:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305452.736997:0:9586:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305453.141486:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305453.537749:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305453.537789:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015148928:0@lo:41: 00000100:00100000:1.0:1788305453.537891:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305453.537980:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148928 00000100:00100000:1.0:1788305453.538003:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148928 00000100:00100000:1.0:1788305453.538066:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305453.538077:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015148928:12345-0@lo:41: 00000004:00000024:1.0:1788305453.538122:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788305453.538802:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015148928:12345-0@lo:41: Request processed in 723us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305453.538813:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305453.539225:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015148928:0@lo:41: 00000100:00100000:2.0:1788305453.540088:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015148800:0@lo:41: 00000100:00100000:2.0:1788305453.540271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305453.541623:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015148800 00000100:00100000:1.0:1788305453.541640:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015148800 00000100:00100000:1.0:1788305453.541714:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305453.541726:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015148800:12345-0@lo:41: 00000004:00000024:1.0:1788305453.541776:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1788305453.542005:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015148800:12345-0@lo:41: Request processed in 271us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305453.542014:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305453.542090:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015148800:0@lo:41: 00010000:00010000:0.0:1788305454.166748:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305455.189713:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305456.213424:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305456.597574:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015149312:0@lo:400: 00000100:00100000:1.0:1788305456.597649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597708:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015149824:0@lo:400: 00000100:00100000:1.0:1788305456.597736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597753:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015150336:0@lo:400: 00000100:00100000:1.0:1788305456.597779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597810:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788305456.597816:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015149184:0@lo:400: 00000100:00100000:1.0:1788305456.597838:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597855:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015149696:0@lo:400: 00000100:00100000:1.0:1788305456.597874:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597884:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015150208:0@lo:400: 00000100:00100000:1.0:1788305456.597905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305456.597931:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149312 00000100:00100000:1.0:1788305456.597939:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149312 00000100:00100000:1.0:1788305456.598134:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305456.598144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015149312:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598210:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015149312:12345-0@lo:400: Request processed in 66us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598218:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305456.598348:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149824 00000100:00100000:1.0:1788305456.598352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149824 00000100:00100000:1.0:1788305456.598385:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150336 00000100:00100000:1.0:1788305456.598388:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150336 00000100:00100000:1.0:1788305456.598401:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149184 00000100:00100000:1.0:1788305456.598404:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149184 00000100:00100000:1.0:1788305456.598413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149696 00000100:00100000:1.0:1788305456.598425:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149696 00000100:00100000:1.0:1788305456.598441:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150208 00000100:00100000:1.0:1788305456.598444:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150208 00000100:00100000:1.0:1788305456.598457:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305456.598463:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015149824:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598509:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015149824:12345-0@lo:400: Request processed in 45us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598515:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788305456.598528:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305456.598534:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015150336:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015150336:12345-0@lo:400: Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598567:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305456.598579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305456.598585:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015149184:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015149184:12345-0@lo:400: Request processed in 25us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598615:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305456.598625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305456.598630:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015149696:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598654:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015149696:12345-0@lo:400: Request processed in 24us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305456.598670:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305456.598676:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015150208:12345-0@lo:400: 00000100:00100000:1.0:1788305456.598700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015150208:12345-0@lo:400: Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305456.598713:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788305456.598759:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb356d80 x1875174015149184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305456.598771:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015149184:0@lo:400: 00010000:00080000:1.0:1788305456.598781:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015149696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305456.598789:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015149696:0@lo:400: 00010000:00080000:1.0:1788305456.598796:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357800 x1875174015150208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305456.598803:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015150208:0@lo:400: 00000100:00100000:1.0:1788305456.598811:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015149312:0@lo:400: 00010000:00080000:1.0:1788305456.598819:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354700 x1875174015149824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305456.598827:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015149824:0@lo:400: 00010000:00080000:1.0:1788305456.598835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355180 x1875174015150336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305456.598842:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015150336:0@lo:400: 00000100:00100000:0.0:1788305456.599020:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015149440:0@lo:400: 00000100:00100000:0.0:1788305456.599051:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.599074:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015149952:0@lo:400: 00000100:00100000:0.0:1788305456.599096:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.599124:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788305456.599131:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015149056:0@lo:400: 00000100:00100000:0.0:1788305456.599155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.599177:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015149568:0@lo:400: 00000100:00100000:0.0:1788305456.599198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.599216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015150080:0@lo:400: 00000100:00100000:0.0:1788305456.599249:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788305456.599293:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305456.599297:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305456.599344:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149952 00000100:00100000:0.0:1788305456.599348:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149952 00000100:00100000:0.0:1788305456.599382:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150080 00000100:00100000:0.0:1788305456.599385:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150080 00000100:00100000:0.0:1788305456.599406:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305456.599413:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015149952:12345-0@lo:400: 00000100:00100000:0.0:1788305456.599455:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015149952:12345-0@lo:400: Request processed in 42us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.599461:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305456.599481:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305456.599498:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015150080:12345-0@lo:400: 00000100:00100000:0.0:1788305456.599528:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015150080:12345-0@lo:400: Request processed in 42us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.599533:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305456.599551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149056 00000100:00100000:0.0:1788305456.599555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149056 00000100:00100000:0.0:1788305456.599576:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788305456.599582:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:3647:x1875174015149056:12345-0@lo:400: 00000100:00100000:0.0:1788305456.599609:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+15:3647:x1875174015149056:12345-0@lo:400: Request processed in 28us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.599614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788305456.599640:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149568 00000100:00100000:0.0:1788305456.599644:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149568 00000100:00100000:0.0:1788305456.599667:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305456.599673:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015149568:12345-0@lo:400: 00000100:00100000:0.0:1788305456.599701:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015149568:12345-0@lo:400: Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.599707:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788305456.599729:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305456.599741:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015150464:0@lo:13: 00000100:00100000:0.0:1788305456.599766:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.599790:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015149056:0@lo:400: 00000100:00100000:0.0:1788305456.599813:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015149568:0@lo:400: 00010000:00080000:0.0:1788305456.599822:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354000 x1875174015150080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305456.599830:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015150080:0@lo:400: 00010000:00080000:0.0:1788305456.599837:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357100 x1875174015149952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305456.599844:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015149952:0@lo:400: 00000100:00100000:0.0:1788305456.599869:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150464 00000100:00100000:0.0:1788305456.599872:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150464 00000100:00100000:0.0:1788305456.599894:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305456.599900:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015150464:12345-0@lo:13: 00002000:00000024:0.0:1788305456.599922:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305456.599958:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015150464:12345-0@lo:13: Request processed in 58us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.599964:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788305456.599989:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e1500 x1875174015150464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305456.600002:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015150464:0@lo:13: 00000100:00100000:0.0:1788305456.600020:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015149440 00000100:00100000:0.0:1788305456.600023:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015149440 00000100:00100000:0.0:1788305456.600047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305456.600053:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015149440:12345-0@lo:400: 00000100:00100000:0.0:1788305456.600087:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015149440:12345-0@lo:400: Request processed in 33us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.600101:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788305456.600129:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354a80 x1875174015149440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305456.600138:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015149440:0@lo:400: 00000100:00100000:2.0:1788305456.601129:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015150592:0@lo:13: 00000100:00100000:2.0:1788305456.601172:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305456.602515:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150592 00000100:00100000:0.0:1788305456.602526:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150592 00000100:00100000:0.0:1788305456.602594:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305456.602605:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015150592:12345-0@lo:13: 00002000:00000024:0.0:1788305456.602629:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305456.609726:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015150592:12345-0@lo:13: Request processed in 7113us (8541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305456.609742:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788305456.615373:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184024380 x1875174015150592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305456.615402:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015150592:0@lo:13: 00010000:00010000:0.0:1788305457.237534:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305458.262562:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305458.529495:0:9876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788305458.649677:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305458.649709:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015150720:0@lo:41: 00000100:00100000:1.0:1788305458.649787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305458.649846:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150720 00000100:00100000:0.0:1788305458.649863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150720 00000100:00100000:2.0:1788305458.649948:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305458.649965:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015150848:0@lo:41: 00000100:00100000:0.0:1788305458.649974:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305458.649992:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015150720:12345-0@lo:41: 00000100:00100000:2.0:1788305458.650012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788305458.650055:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788305458.650187:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015150720:12345-0@lo:41: Request processed in 198us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305458.650195:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305458.650223:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150848 00000100:00100000:1.0:1788305458.650230:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015150720:0@lo:41: 00000100:00100000:0.0:1788305458.650231:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150848 00000100:00100000:0.0:1788305458.650266:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788305458.650303:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015150848:12345-0@lo:41: 00000004:00000024:0.0:1788305458.650350:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788305458.650401:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015150848:12345-0@lo:41: Request processed in 126us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305458.650517:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015150848:0@lo:41: 00000100:00100000:0.0:1788305458.650646:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1788305459.285810:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788305460.294385:0:9928:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305460.294751:0:9928:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788305460.314859:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788305461.206780:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788305461.206814:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891b9152800 from 39 10000000:01000000:1.0:1788305461.206821:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305461.206904:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.206918:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.206933:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305461.206964:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015150976:0@lo:101: 00000100:00100000:1.0:1788305461.207055:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.207122:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305461.207808:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015150976 00000100:00100000:3.0:1788305461.207821:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015150976 00000100:00100000:3.0:1788305461.207895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788305461.207908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015150976:12345-0@lo:101: 00010000:00010000:3.0:1788305461.207926:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305461.207945:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60533df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305461.207979:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60533df expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305461.207992:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533df expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305461.208004:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519400, rc 0) 00000100:00100000:3.0:1788305461.208079:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015150976:12345-0@lo:101: Request processed in 174us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305461.208086:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788305461.214029:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015150976:0@lo:101: 00010000:00010000:1.0:1788305461.214073:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.214090:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305461.214219:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151104:0@lo:501: 00000100:00100000:1.0:1788305461.214334:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.214386:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305461.214493:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151104 00000100:00100000:3.0:1788305461.214501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151104 00000100:00100000:3.0:1788305461.214566:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788305461.214579:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015151104:12345-0@lo:501: 00000100:00100000:3.0:1788305461.215817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015151104:12345-0@lo:501: Request processed in 1234us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305461.215829:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788305461.219717:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151104:0@lo:501: 00000100:00100000:2.0:1788305461.219795:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151232:0@lo:503: 00000100:00100000:2.0:1788305461.219884:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.219929:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.219954:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151232 00000100:00100000:2.0:1788305461.219961:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151232 00000100:00100000:2.0:1788305461.220013:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788305461.220025:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015151232:12345-0@lo:503: 00000100:00100000:2.0:1788305461.220184:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015151232:12345-0@lo:503: Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.220193:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788305461.220579:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151232:0@lo:503: 00000100:00100000:2.0:1788305461.246050:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9953:1875174015151360:0@lo:502: 00000100:00100000:2.0:1788305461.246188:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.246296:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.246380:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151360 00000100:00100000:1.0:1788305461.246390:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151360 00000100:00100000:1.0:1788305461.246467:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788305461.246479:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9953:x1875174015151360:12345-0@lo:502: 00000100:00100000:1.0:1788305461.246651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:9953:x1875174015151360:12345-0@lo:502: Request processed in 174us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.246666:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788305461.247395:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9953:1875174015151360:0@lo:502: 00000100:00100000:2.0:1788305461.247479:0:9953:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9953:1875174015151488:0@lo:502: 00000100:00100000:2.0:1788305461.247522:0:9953:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.247558:0:9953:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.247641:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151488 00000100:00100000:1.0:1788305461.247647:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151488 00000100:00100000:1.0:1788305461.247688:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788305461.247697:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9953:x1875174015151488:12345-0@lo:502: 00000100:00100000:1.0:1788305461.247802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:9953:x1875174015151488:12345-0@lo:502: Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.247810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788305461.248055:0:9953:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9953:1875174015151488:0@lo:502: 00000040:00080000:2.0:1788305461.248079:0:9953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788305461.248456:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788305461.248491:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305461.248504:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.248515:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305461.248526:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788305461.248541:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788305461.248544:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788305461.248576:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.248584:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.248594:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305461.248608:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151616:0@lo:101: 00000100:00100000:1.0:1788305461.248654:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.248680:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.250064:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151616 00000100:00100000:2.0:1788305461.250076:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151616 00000100:00100000:2.0:1788305461.250153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788305461.250165:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015151616:12345-0@lo:101: 00010000:00010000:2.0:1788305461.250183:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305461.250332:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60533ed expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.250369:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60533ed expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.250383:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533ed expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.250413:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305461.250505:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015151616:12345-0@lo:101: Request processed in 342us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.250512:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788305461.250543:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151616:0@lo:101: 00010000:00010000:0.0:1788305461.250565:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.250575:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.250659:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151744:0@lo:501: 00000100:00100000:0.0:1788305461.250697:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.250732:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918caed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.251477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151744 00000100:00100000:2.0:1788305461.251484:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151744 00000100:00100000:2.0:1788305461.251559:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788305461.251567:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015151744:12345-0@lo:501: 00000100:00100000:2.0:1788305461.251724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015151744:12345-0@lo:501: Request processed in 157us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.251731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788305461.271601:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151744:0@lo:501: 00000100:00100000:2.0:1788305461.271694:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151872:0@lo:503: 00000100:00100000:2.0:1788305461.271817:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.271872:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.273199:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015151872 00000100:00100000:1.0:1788305461.273223:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015151872 00000100:00100000:1.0:1788305461.273312:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788305461.273323:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015151872:12345-0@lo:503: 00000100:00100000:1.0:1788305461.273542:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015151872:12345-0@lo:503: Request processed in 210us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.273551:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788305461.273621:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015151872:0@lo:503: 00000100:00100000:1.0:1788305461.273889:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9954:1875174015152000:0@lo:502: 00000100:00100000:1.0:1788305461.273954:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.273983:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.278697:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152000 00000100:00100000:0.0:1788305461.278718:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152000 00000100:00100000:0.0:1788305461.278793:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788305461.278806:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:9954:x1875174015152000:12345-0@lo:502: 00000100:00100000:0.0:1788305461.279055:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:9954:x1875174015152000:12345-0@lo:502: Request processed in 251us (5100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.279064:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788305461.288067:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9954:1875174015152000:0@lo:502: 00000020:01000000:1.0:1788305461.288132:0:9954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305461.288146:0:9954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.288149:0:9954:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305461.288153:0:9954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305461.288155:0:9954:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788305461.288198:0:9954:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9954:1875174015152128:0@lo:502: 00000100:00100000:1.0:1788305461.291900:0:9954:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.291944:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152128 00000100:00100000:0.0:1788305461.291955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152128 00000100:00100000:1.0:1788305461.291959:0:9954:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.292034:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788305461.292047:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:9954:x1875174015152128:12345-0@lo:502: 00000100:00100000:0.0:1788305461.292226:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:9954:x1875174015152128:12345-0@lo:502: Request processed in 181us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.292235:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788305461.296963:0:9954:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9954:1875174015152128:0@lo:502: 00000020:01000000:1.0:1788305461.297023:0:9954:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305461.297033:0:9954:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.297036:0:9954:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788305461.297042:0:9954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788305461.297418:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788305461.297461:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788305461.297476:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.297491:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305461.297504:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788305461.297507:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891894cd800 from 39 10000000:01000000:2.0:1788305461.297510:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305461.297560:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.297570:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.297581:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.297606:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152256:0@lo:101: 00000100:00100000:2.0:1788305461.297690:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.297751:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.298011:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152256 00000100:00100000:0.0:1788305461.298021:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152256 00000100:00100000:0.0:1788305461.298080:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305461.298093:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015152256:12345-0@lo:101: 00010000:00010000:0.0:1788305461.298109:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305461.298126:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60533fb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.298154:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60533fb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.298166:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533fb expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.298176:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ba00, rc 0) 00000100:00100000:0.0:1788305461.298233:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152256:12345-0@lo:101: Request processed in 141us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.298241:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788305461.298350:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152256:0@lo:101: 00010000:00010000:2.0:1788305461.298366:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.298376:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.298441:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152384:0@lo:501: 00000100:00100000:2.0:1788305461.298480:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.298498:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb569c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.298658:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152384 00000100:00100000:0.0:1788305461.298662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152384 00000100:00100000:0.0:1788305461.298695:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305461.298703:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152384:12345-0@lo:501: 00000100:00100000:0.0:1788305461.298846:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152384:12345-0@lo:501: Request processed in 143us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.298852:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788305461.298914:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152384:0@lo:501: 00000100:00100000:2.0:1788305461.298956:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152512:0@lo:503: 00000100:00100000:2.0:1788305461.298999:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.299019:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.299032:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152512 00000100:00100000:2.0:1788305461.299035:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152512 00000100:00100000:2.0:1788305461.299073:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305461.299080:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152512:12345-0@lo:503: 00000100:00100000:2.0:1788305461.299187:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152512:12345-0@lo:503: Request processed in 107us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.299194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305461.299747:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152512:0@lo:503: 00000100:00100000:2.0:1788305461.302254:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9956:1875174015152640:0@lo:502: 00000100:00100000:2.0:1788305461.302375:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.302420:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.302604:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152640 00000100:00100000:1.0:1788305461.302614:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152640 00000100:00100000:1.0:1788305461.302671:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305461.302682:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:9956:x1875174015152640:12345-0@lo:502: 00000100:00100000:1.0:1788305461.302839:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:9956:x1875174015152640:12345-0@lo:502: Request processed in 158us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.302846:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305461.303024:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9956:1875174015152640:0@lo:502: 00000100:00100000:1.0:1788305461.303081:0:9956:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9956:1875174015152768:0@lo:502: 00000100:00100000:1.0:1788305461.303120:0:9956:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.303154:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152768 00000100:00100000:1.0:1788305461.303157:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152768 00000100:00100000:1.0:1788305461.303174:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788305461.303180:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:9956:x1875174015152768:12345-0@lo:502: 00000100:00100000:1.0:1788305461.303254:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:9956:x1875174015152768:12345-0@lo:502: Request processed in 73us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.303261:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788305461.303317:0:9956:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.303329:0:9956:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9956:1875174015152768:0@lo:502: 00000040:00080000:1.0:1788305461.303347:0:9956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1788305461.303420:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788305461.303459:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305461.303472:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303484:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305461.303506:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788305461.303510:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8891894cd800 from 6 10000000:01000000:1.0:1788305461.303512:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788305461.303559:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303569:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303579:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305461.303594:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152896:0@lo:101: 00000100:00100000:1.0:1788305461.303622:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.303636:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.303648:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015152896 00000100:00100000:1.0:1788305461.303651:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015152896 00000100:00100000:1.0:1788305461.303668:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788305461.303674:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015152896:12345-0@lo:101: 00010000:00010000:1.0:1788305461.303683:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305461.303698:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564200/0x4a426866e6053410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053409 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303722:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564200/0x4a426866e6053410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053409 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303733:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564200/0x4a426866e6053410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053409 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.303757:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564200, rc 0) 00000100:00100000:1.0:1788305461.303798:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015152896:12345-0@lo:101: Request processed in 123us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.303804:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788305461.304201:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015152896:0@lo:101: 00010000:00010000:0.0:1788305461.304216:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.304226:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.304302:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153024:0@lo:256: 00000100:00100000:0.0:1788305461.304341:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.304363:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.306037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153024 00000100:00100000:2.0:1788305461.306055:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153024 00000100:00100000:2.0:1788305461.306151:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788305461.306165:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015153024:12345-0@lo:256: 20000000:01000000:2.0:1788305461.306200:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305461.306459:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305461.306463:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788305461.306644:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015153024:12345-0@lo:256: Request processed in 480us (2300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.306653:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788305461.306742:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153024:0@lo:256: 10000000:01000000:0.0:1788305461.306820:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305461.306831:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.306842:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305461.306852:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788305461.306856:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788305461.306859:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788305461.306907:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.306916:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.306926:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.306957:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153152:0@lo:101: 00000100:00100000:0.0:1788305461.306991:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.307035:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.308025:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153152 00000100:00100000:2.0:1788305461.308034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153152 00000100:00100000:2.0:1788305461.308085:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788305461.308094:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015153152:12345-0@lo:101: 00010000:00010000:2.0:1788305461.308110:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305461.308128:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053417 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.309101:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053417 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.309114:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053417 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.309124:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:1.0:1788305461.311337:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153152:0@lo:101: 00010000:00010000:1.0:1788305461.311373:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305461.311388:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305461.311531:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153280:0@lo:501: 00000100:00100000:1.0:1788305461.311591:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.311635:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.311657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153280 00000100:00100000:1.0:1788305461.311663:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153280 00000100:00100000:1.0:1788305461.311706:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788305461.311715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015153280:12345-0@lo:501: 00000100:00100000:2.0:1788305461.311887:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015153152:12345-0@lo:101: Request processed in 2823us (3924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.311897:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788305461.316825:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015153280:12345-0@lo:501: Request processed in 5097us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.316843:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788305461.316941:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153280:0@lo:501: 00000100:00100000:1.0:1788305461.317011:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153408:0@lo:503: 00000100:00100000:1.0:1788305461.317076:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.317117:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.317145:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153408 00000100:00100000:1.0:1788305461.317153:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153408 00000100:00100000:1.0:1788305461.317198:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305461.317209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015153408:12345-0@lo:503: 00000100:00100000:1.0:1788305461.317356:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015153408:12345-0@lo:503: Request processed in 148us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.317363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305461.317407:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015153408:0@lo:503: 00000100:00100000:0.0:1788305461.324031:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9957:1875174015153536:0@lo:502: 00000100:00100000:0.0:1788305461.324170:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.324235:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.325869:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153536 00000100:00100000:1.0:1788305461.325887:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153536 00000100:00100000:1.0:1788305461.328515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788305461.330784:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:9957:x1875174015153536:12345-0@lo:502: 00000100:00100000:1.0:1788305461.332071:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:9957:x1875174015153536:12345-0@lo:502: Request processed in 3535us (7894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.332086:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788305461.332539:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9957:1875174015153536:0@lo:502: 00000020:01000000:2.0:1788305461.332590:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305461.332602:0:9957:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788305461.332612:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305461.332615:0:9957:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788305461.332622:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788305461.332626:0:9957:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:2.0:1788305461.332657:0:9957:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788305461.332660:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305461.332681:0:9957:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8891bb4f0000) 00000020:00000080:2.0:1788305461.332715:0:9957:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788305461.332722:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788305461.332874:0:9957:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788305461.332883:0:9957:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788305461.332894:0:9957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e605342c 00010000:00080000:2.0:1788305461.332954:0:9957:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bf944000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305461.334358:0:9957:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788305461.334574:0:9957:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788305461.334596:0:9957:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788305461.334982:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305461.335110:0:9957:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305461.337598:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788305461.337755:0:9957:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00010000:00010000:0.0:1788305461.338577:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305461.341152:0:9960:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305461.341160:0:9960:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788305461.345473:0:9957:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305461.345493:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788305461.345554:0:9957:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788305461.345594:0:9957:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6053433 00000100:00080000:0.0:1788305461.345606:0:9957:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305461.345613:0:9957:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891bf944000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305461.345656:0:9957:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8890836e0700 x1875174015153664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305461.345684:0:9957:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788305461.345740:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305461.345744:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305461.345746:0:9957:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788305461.345759:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305461.345764:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305461.345765:0:9957:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788305461.345768:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788305461.345770:0:9957:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788305461.345804:0:9957:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9957:1875174015153792:0@lo:502: 00000100:00100000:2.0:1788305461.346173:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015154048:0@lo:400: 00000100:00100000:2.0:1788305461.346211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346242:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015154560:0@lo:400: 00000100:00100000:2.0:1788305461.346264:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346296:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015155072:0@lo:400: 00000100:00100000:2.0:1788305461.346344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346368:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305461.346373:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015153920:0@lo:400: 00000100:00100000:2.0:1788305461.346391:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346405:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015154432:0@lo:400: 00000100:00100000:2.0:1788305461.346422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346430:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015154944:0@lo:400: 00000100:00100000:2.0:1788305461.346455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346474:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015154176:0@lo:400: 00000100:00100000:2.0:1788305461.346497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346506:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015154688:0@lo:400: 00000100:00100000:2.0:1788305461.346524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346540:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788305461.346545:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015154304:0@lo:400: 00000100:00100000:2.0:1788305461.346561:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346575:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015154816:0@lo:400: 00000100:00100000:2.0:1788305461.346602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.346630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154560 00000100:00100000:2.0:1788305461.346637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154560 00000100:00100000:2.0:1788305461.346696:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155072 00000100:00100000:2.0:1788305461.346699:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155072 00000100:00100000:2.0:1788305461.346711:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153920 00000100:00100000:2.0:1788305461.346713:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153920 00000100:00100000:2.0:1788305461.346722:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154432 00000100:00100000:2.0:1788305461.346724:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154432 00000100:00100000:2.0:1788305461.346734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154944 00000100:00100000:2.0:1788305461.346736:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154944 00000100:00100000:2.0:1788305461.346744:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154176 00000100:00100000:2.0:1788305461.346746:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154176 00000100:00100000:2.0:1788305461.346759:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305461.346767:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015154560:12345-0@lo:400: 00000100:00100000:2.0:1788305461.346819:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015154560:12345-0@lo:400: Request processed in 52us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.346827:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305461.346840:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305461.346845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015155072:12345-0@lo:400: 00000100:00100000:2.0:1788305461.346865:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015155072:12345-0@lo:400: Request processed in 21us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.346870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788305461.346879:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305461.346885:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015153920:12345-0@lo:400: 00000100:00100000:2.0:1788305461.346907:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015153920:12345-0@lo:400: Request processed in 22us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.346912:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305461.347022:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305461.347036:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015154432:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347063:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015154432:12345-0@lo:400: Request processed in 29us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305461.347080:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305461.347084:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015154944:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015154944:12345-0@lo:400: Request processed in 19us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305461.347116:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305461.347121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015154176:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347197:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015154176:12345-0@lo:400: Request processed in 75us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788305461.347225:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154688 00000100:00100000:2.0:1788305461.347228:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154688 00000100:00100000:2.0:1788305461.347252:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154816 00000100:00100000:2.0:1788305461.347254:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154816 00000100:00100000:2.0:1788305461.347270:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305461.347293:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015154688:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347322:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015154688:12345-0@lo:400: Request processed in 47us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347327:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305461.347337:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305461.347341:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015154816:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347360:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015154816:12345-0@lo:400: Request processed in 19us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347372:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305461.347389:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154048 00000100:00100000:2.0:1788305461.347392:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154048 00000100:00100000:2.0:1788305461.347414:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015154304 00000100:00100000:2.0:1788305461.347416:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015154304 00000100:00100000:2.0:1788305461.347426:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305461.347431:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015154048:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347475:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015154048:12345-0@lo:400: Request processed in 43us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347481:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305461.347490:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305461.347496:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015154304:12345-0@lo:400: 00000100:00100000:2.0:1788305461.347515:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015154304:12345-0@lo:400: Request processed in 20us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.347520:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1788305461.347537:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305461.347542:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305461.347544:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305461.347582:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015154304:0@lo:400: 00010000:00080000:2.0:1788305461.347594:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d44700 x1875174015154816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347604:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015154816:0@lo:400: 00010000:00080000:2.0:1788305461.347613:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082050000 x1875174015154176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347620:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015154176:0@lo:400: 00010000:00080000:2.0:1788305461.347629:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082051880 x1875174015154688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347643:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015154688:0@lo:400: 00010000:00080000:2.0:1788305461.347676:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268000 x1875174015153920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347684:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015153920:0@lo:400: 00010000:00080000:2.0:1788305461.347694:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082051180 x1875174015154432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347701:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015154432:0@lo:400: 00010000:00080000:2.0:1788305461.347710:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d47b80 x1875174015154944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347717:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015154944:0@lo:400: 00000100:00100000:2.0:1788305461.347725:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015154048:0@lo:400: 00010000:00080000:2.0:1788305461.347733:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053100 x1875174015154560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347740:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015154560:0@lo:400: 00010000:00080000:2.0:1788305461.347748:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356dc00 x1875174015155072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.347757:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015155072:0@lo:400: 00000100:00100000:0.0:1788305461.348360:0:9957:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.348540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015153664:0@lo:8: 00000100:00100000:1.0:1788305461.348590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.348668:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153664 00000100:00100000:1.0:1788305461.348673:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153664 00000100:00100000:1.0:1788305461.348703:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305461.348709:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875174015153664:12345-0@lo:8: 00010000:00080000:1.0:1788305461.348740:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:1.0:1788305461.348786:0:8435:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605343a 00002000:00100000:1.0:1788305461.348805:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff88908273a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788305461.348809:0:8435:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788305461.348814:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788305461.348910:0:8435:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788305461.349858:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015153792 00000100:00100000:2.0:1788305461.349867:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015153792 00002000:00080000:1.0:1788305461.350058:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788305461.350097:0:8435:0:(import.c:65:import_set_state_nolock()) ffff88908273c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305461.350338:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015153664:12345-0@lo:8: Request processed in 1625us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.350347:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788305461.350408:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e0700 x1875174015153664/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.350420:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305461.350431:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788305461.350441:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788305461.350458:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788305461.350460:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf944000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788305461.350476:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788305461.350483:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015153664:0@lo:8: 00000100:00100000:1.0:1788305461.350547:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015155200:0@lo:700: 00000100:00100000:1.0:1788305461.350583:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.350615:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155200 00000100:00100000:1.0:1788305461.350619:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155200 00000100:00100000:1.0:1788305461.350660:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305461.350669:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9961:x1875174015155200:12345-0@lo:700: 00000100:00100000:1.0:1788305461.350729:0:8445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875174015155328:0@lo:700: 00000100:00100000:2.0:1788305461.350894:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788305461.350907:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+20:9957:x1875174015153792:12345-0@lo:502: 00000100:00100000:2.0:1788305461.351110:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+20:9957:x1875174015153792:12345-0@lo:502: Request processed in 207us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.351124:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000004:00080000:0.0:1788305461.352056:0:9960:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788305461.352165:0:9960:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 291442889517ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788305461.352173:0:9960:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788305461.352465:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.352500:0:8445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.352537:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155328 00000100:00100000:1.0:1788305461.352543:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155328 00000100:00100000:1.0:1788305461.352594:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305461.352619:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875174015155328:12345-0@lo:700: 00000100:00080000:1.0:1788305461.352737:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305461.353383:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.360855:0:9957:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.360916:0:9957:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9957:1875174015153792:0@lo:502: 00000020:01000000:2.0:1788305461.360987:0:9957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305461.360995:0:9957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305461.360997:0:9957:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788305461.361003:0:9957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:0.0:1788305461.369526:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788305461.369588:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788305461.369605:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.369622:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305461.369638:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788305461.369641:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a3800 from 39 10000000:01000000:0.0:1788305461.369644:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305461.369694:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.369704:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.369716:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.369746:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155456:0@lo:101: 00000100:00100000:0.0:1788305461.369854:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.369910:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.370419:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155456 00000100:00100000:2.0:1788305461.370429:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155456 00000100:00100000:2.0:1788305461.370500:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788305461.370512:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015155456:12345-0@lo:101: 00010000:00010000:2.0:1788305461.370529:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305461.370546:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053441 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.370607:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053441 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.370621:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053441 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.370631:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305461.370691:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015155456:12345-0@lo:101: Request processed in 181us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.370699:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788305461.370766:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155456:0@lo:101: 00010000:00010000:2.0:1788305461.370783:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.370806:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.370883:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155584:0@lo:501: 00000100:00100000:2.0:1788305461.370914:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305461.379069:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.392246:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155584 00000100:00100000:0.0:1788305461.392267:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155584 00000100:00100000:0.0:1788305461.392366:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788305461.392390:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015155584:12345-0@lo:501: 00000100:00100000:0.0:1788305461.392650:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015155584:12345-0@lo:501: Request processed in 263us (21734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.392659:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788305461.395439:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155584:0@lo:501: 00000100:00100000:3.0:1788305461.395519:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155712:0@lo:503: 00000100:00100000:3.0:1788305461.395603:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305461.395648:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2daf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.395832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155712 00000100:00100000:0.0:1788305461.395845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155712 00000100:00100000:0.0:1788305461.395933:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788305461.395946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015155712:12345-0@lo:503: 00000100:00100000:0.0:1788305461.396137:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015155712:12345-0@lo:503: Request processed in 194us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.396158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788305461.396270:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015155712:0@lo:503: 00000100:00100000:3.0:1788305461.397147:0:9963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9963:1875174015155840:0@lo:502: 00000100:00100000:3.0:1788305461.397214:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305461.397256:0:9963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.397368:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155840 00000100:00100000:0.0:1788305461.397375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155840 00000100:00100000:0.0:1788305461.397435:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788305461.397454:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:9963:x1875174015155840:12345-0@lo:502: 00000100:00100000:0.0:1788305461.397581:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:9963:x1875174015155840:12345-0@lo:502: Request processed in 137us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.397589:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788305461.397721:0:9963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9963:1875174015155840:0@lo:502: 00000100:00100000:3.0:1788305461.397764:0:9963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9963:1875174015155968:0@lo:502: 00000100:00100000:3.0:1788305461.397796:0:9963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305461.397821:0:9963:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.398893:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015155968 00000100:00100000:2.0:1788305461.398908:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015155968 00000004:00080000:2.0:1788305461.399075:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788305461.399478:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788305461.399492:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:9963:x1875174015155968:12345-0@lo:502: 00000100:00100000:2.0:1788305461.399709:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:9963:x1875174015155968:12345-0@lo:502: Request processed in 219us (1911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.399720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788305461.399795:0:9963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9963:1875174015155968:0@lo:502: 00000040:00080000:3.0:1788305461.399856:0:9963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788305461.400120:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788305461.400145:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305461.400156:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400165:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305461.400175:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305461.400186:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a3800 from 6 10000000:01000000:0.0:1788305461.400189:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305461.400223:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400230:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400239:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.400255:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156096:0@lo:101: 00000100:00100000:0.0:1788305461.400349:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.400409:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.400431:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156096 00000100:00100000:0.0:1788305461.400437:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156096 00000100:00100000:0.0:1788305461.400486:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788305461.400496:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015156096:12345-0@lo:101: 00010000:00010000:0.0:1788305461.400508:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305461.400522:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b400/0x4a426866e6053456 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605344f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400543:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b400/0x4a426866e6053456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605344f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400554:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b400/0x4a426866e6053456 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605344f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400563:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b400, rc 0) 00000100:00100000:0.0:1788305461.400609:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015156096:12345-0@lo:101: Request processed in 113us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.400629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788305461.400676:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156096:0@lo:101: 00010000:00010000:0.0:1788305461.400689:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.400699:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.400751:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156224:0@lo:256: 00000100:00100000:0.0:1788305461.400799:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.400811:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.400890:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156224 00000100:00100000:0.0:1788305461.400894:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156224 00000100:00100000:0.0:1788305461.400912:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788305461.400917:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015156224:12345-0@lo:256: 20000000:01000000:0.0:1788305461.400929:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788305461.400947:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788305461.400950:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788305461.401025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015156224:12345-0@lo:256: Request processed in 106us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.401032:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788305461.401060:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156224:0@lo:256: 10000000:01000000:0.0:1788305461.401102:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305461.401108:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401114:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305461.401127:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788305461.401129:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788305461.401132:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305461.401145:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401152:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401158:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.401168:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156352:0@lo:101: 00000100:00100000:0.0:1788305461.401190:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.401203:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f896c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305461.401213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156352 00000100:00100000:0.0:1788305461.401216:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156352 00000100:00100000:0.0:1788305461.401231:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788305461.401237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015156352:12345-0@lo:101: 00010000:00010000:0.0:1788305461.401243:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305461.401251:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605345d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401264:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605345d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401271:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605345d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401308:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a600, rc 0) 00000100:00100000:0.0:1788305461.401345:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015156352:12345-0@lo:101: Request processed in 107us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.401353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788305461.401388:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156352:0@lo:101: 00010000:00010000:0.0:1788305461.401398:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305461.401405:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305461.401467:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156480:0@lo:501: 00000100:00100000:0.0:1788305461.401493:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.401523:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f896c0 going to sleep for 11 seconds 40000000:02000000:3.0:1788305461.402504:0:6526:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788305461.403555:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156480 00000100:00100000:2.0:1788305461.403570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156480 00000100:00100000:2.0:1788305461.403645:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305461.403656:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015156480:12345-0@lo:501: 00000100:00100000:2.0:1788305461.403884:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015156480:12345-0@lo:501: Request processed in 229us (2390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.403893:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305461.403969:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156480:0@lo:501: 00000100:00100000:2.0:1788305461.404031:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156608:0@lo:503: 00000100:00100000:2.0:1788305461.404084:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.404119:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.404133:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156608 00000100:00100000:2.0:1788305461.404397:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156608 00000100:00100000:2.0:1788305461.404426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788305461.404433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015156608:12345-0@lo:503: 00000100:00100000:2.0:1788305461.404531:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015156608:12345-0@lo:503: Request processed in 98us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.404538:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788305461.404579:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015156608:0@lo:503: 00000100:00100000:1.0:1788305461.405692:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9964:1875174015156736:0@lo:502: 00000100:00100000:1.0:1788305461.406431:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.406467:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.406558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156736 00000100:00100000:2.0:1788305461.406575:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156736 00000100:00100000:2.0:1788305461.406637:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788305461.406647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:9964:x1875174015156736:12345-0@lo:502: 00000100:00100000:2.0:1788305461.406835:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:9964:x1875174015156736:12345-0@lo:502: Request processed in 188us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.406844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788305461.406886:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9964:1875174015156736:0@lo:502: 00000020:01000000:1.0:1788305461.406938:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305461.406948:0:9964:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788305461.406958:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.406961:0:9964:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788305461.406967:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305461.406971:0:9964:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:1.0:1788305461.407014:0:9964:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788305461.407018:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305461.407038:0:9964:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8890833db370) 00000020:00000080:1.0:1788305461.407070:0:9964:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788305461.407076:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305461.407489:0:9964:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788305461.407495:0:9964:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788305461.407505:0:9964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6053472 00010000:00080000:1.0:1788305461.407544:0:9964:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891b8d02800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305461.407865:0:9964:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788305461.408059:0:9964:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788305461.408075:0:9964:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788305461.409889:0:9964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305461.410079:0:9964:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305461.413125:0:9964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788305461.416770:0:9964:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788305461.419547:0:9965:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305461.419559:0:9965:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788305461.424174:0:9964:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305461.424199:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305461.424501:0:9964:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788305461.424537:0:9964:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6053479 00000100:00080000:1.0:1788305461.424552:0:9964:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305461.424560:0:9964:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8891b8d02800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305461.424610:0:9964:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb357b80 x1875174015156864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305461.424644:0:9964:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788305461.424713:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305461.424718:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.424720:0:9964:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788305461.424723:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305461.424727:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.424729:0:9964:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305461.424732:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305461.424734:0:9964:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788305461.424771:0:9964:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9964:1875174015156992:0@lo:502: 00000100:00100000:1.0:1788305461.424881:0:9964:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.425497:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015156864:0@lo:8: 00000100:00100000:2.0:1788305461.425585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.425671:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156864 00000100:00100000:2.0:1788305461.425679:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156864 00000100:00100000:2.0:1788305461.425712:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305461.425719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015156864:12345-0@lo:8: 00010000:00080000:2.0:1788305461.425750:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:2.0:1788305461.425780:0:8436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6053480 00002000:00100000:2.0:1788305461.425794:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8891bf946800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788305461.425799:0:8436:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788305461.425801:0:8436:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788305461.425871:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305461.425907:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8891bf942000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305461.425958:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015156864:12345-0@lo:8: Request processed in 238us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.425966:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788305461.426006:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015156864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.426016:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305461.426024:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788305461.426031:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788305461.426036:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788305461.426038:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891b8d02800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788305461.426049:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788305461.426053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015156864:0@lo:8: 00000004:00080000:2.0:1788305461.426076:0:9965:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305461.426127:0:9965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 291516850759ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788305461.426133:0:9965:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788305461.427116:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015156992 00000100:00100000:1.0:1788305461.427129:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015156992 00000100:00100000:1.0:1788305461.427269:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788305461.427309:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:9964:x1875174015156992:12345-0@lo:502: 00000100:00100000:1.0:1788305461.427527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:9964:x1875174015156992:12345-0@lo:502: Request processed in 221us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.427534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788305461.427594:0:9964:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.427635:0:9964:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:9964:1875174015156992:0@lo:502: 00000020:01000000:1.0:1788305461.427676:0:9964:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305461.427685:0:9964:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305461.427688:0:9964:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788305461.427694:0:9964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:2.0:1788305461.434092:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:2.0:1788305461.434145:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788305461.434158:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434172:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305461.434186:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788305461.434190:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889186788000 from 1 10000000:01000000:2.0:1788305461.434193:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788305461.434247:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434293:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434307:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.434330:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015157120:0@lo:101: 00000100:00100000:2.0:1788305461.434395:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.434433:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.434505:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157120 00000100:00100000:2.0:1788305461.434515:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157120 00000100:00100000:2.0:1788305461.434564:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788305461.434574:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015157120:12345-0@lo:101: 00010000:00010000:2.0:1788305461.434586:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305461.434599:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053487 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434620:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053487 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434629:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053487 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434638:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305461.434681:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015157120:12345-0@lo:101: Request processed in 108us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.434688:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788305461.434729:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015157120:0@lo:101: 00010000:00010000:2.0:1788305461.434750:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.434757:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.434812:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015157248:0@lo:501: 00000100:00100000:2.0:1788305461.434838:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.434852:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.434865:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157248 00000100:00100000:2.0:1788305461.434869:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157248 00000100:00100000:2.0:1788305461.434897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788305461.434904:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015157248:12345-0@lo:501: 00000100:00100000:2.0:1788305461.434972:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015157248:12345-0@lo:501: Request processed in 67us (132us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305461.434979:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788305461.435007:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015157248:0@lo:501: 10000000:01000000:2.0:1788305461.435026:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788305461.435032:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305461.435039:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305461.435086:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8445:x1875174015155328:12345-0@lo:700: Request processed in 82468us (82622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.435095:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788305461.435181:0:8445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015155328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.435202:0:8445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8445:1875174015155328:0@lo:700: 40000000:02000000:1.0:1788305461.435228:0:8445:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000001:00100000:2.0:1788305461.454386:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788305461.454397:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788305461.454713:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015155200:12345-0@lo:700: Request processed in 104040us (104124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.454725:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788305461.454872:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355180 x1875174015155200/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.454885:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015155200:0@lo:700: 00000004:00080000:0.0:1788305461.466220:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788305461.477589:0:9961:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788305461.477624:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015157504:0@lo:7: 00000100:00100000:1.0:1788305461.477690:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.477731:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.477753:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157504 00000100:00100000:1.0:1788305461.477759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157504 00000100:00100000:1.0:1788305461.477805:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305461.477814:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015157504:12345-0@lo:7: 00000100:00100000:2.0:1788305461.478314:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015157376:0@lo:13: 00000100:00100000:2.0:1788305461.478347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305461.478387:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157376 00000100:00100000:2.0:1788305461.478392:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157376 00000100:00100000:2.0:1788305461.478419:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305461.478425:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015157376:12345-0@lo:13: 00002000:00000024:2.0:1788305461.478454:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:2.0:1788305461.478498:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015157376:12345-0@lo:13: Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.478506:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788305461.478548:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015157376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.478567:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015157376:0@lo:13: 00000100:00100000:0.0:1788305461.486947:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305461.486970:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015157632:0@lo:13: 00000100:00100000:0.0:1788305461.487060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.487109:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157632 00000100:00100000:0.0:1788305461.487117:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157632 00000100:00100000:0.0:1788305461.487177:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305461.487189:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015157632:12345-0@lo:13: 00002000:00000024:0.0:1788305461.487212:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923931136 avail 3692408832 00000100:00100000:0.0:1788305461.487259:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015157632:12345-0@lo:13: Request processed in 72us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.487266:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788305461.487315:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305461.487344:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2d80 x1875174015157632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305461.487364:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015157632:0@lo:13: 00000004:00080000:0.0:1788305461.487383:0:9966:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788305461.487402:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015157760:0@lo:7: 00000100:00100000:0.0:1788305461.487430:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.487465:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305461.487474:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157760 00000100:00100000:3.0:1788305461.487478:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157760 00000100:00100000:3.0:1788305461.487520:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305461.487528:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9966:x1875174015157760:12345-0@lo:7: 00002000:00080000:1.0:1788305461.489160:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788305461.489168:0:8435:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788305461.489489:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015157504:12345-0@lo:7: Request processed in 11673us (11795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.489499:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788305461.499862:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb356d80 x1875174015157504/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305461.499881:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015157504:0@lo:7: 00000004:00080000:0.0:1788305461.499896:0:9961:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788305461.506820:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015157888:0@lo:5: 00000100:00100000:1.0:1788305461.506895:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1788305461.509001:0:8436:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788305461.509012:0:8436:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788305461.509200:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.509350:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9966:x1875174015157760:12345-0@lo:7: Request processed in 21818us (21914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.509360:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305461.509386:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015157888 00000100:00100000:1.0:1788305461.509395:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015157888 00000100:00100000:1.0:1788305461.509440:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305461.509461:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015157888:12345-0@lo:5: 00002000:00080000:1.0:1788305461.509489:0:8436:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788305461.509520:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015157888:12345-0@lo:5: Request processed in 61us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.509526:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788305461.510625:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015157888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.510642:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015157888:0@lo:5: 00000004:00080000:1.0:1788305461.510656:0:9961:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788305461.510695:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015158016:0@lo:5: 00000100:00100000:1.0:1788305461.510734:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.510764:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158016 00000100:00100000:1.0:1788305461.510769:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158016 00000100:00100000:1.0:1788305461.510799:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305461.510807:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9961:x1875174015158016:12345-0@lo:5: 00002000:00080000:1.0:1788305461.510838:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00010000:00080000:0.0:1788305461.515759:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2d80 x1875174015157760/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305461.515777:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015157760:0@lo:7: 00000004:00080000:0.0:1788305461.515791:0:9966:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788305461.515828:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158144:0@lo:5: 00000100:00100000:0.0:1788305461.515885:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.515926:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158144 00000100:00100000:0.0:1788305461.515932:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158144 00000100:00100000:1.0:1788305461.516894:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:9961:x1875174015158016:12345-0@lo:5: Request processed in 6083us (6156us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788305461.516903:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305461.516932:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305461.516940:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9966:x1875174015158144:12345-0@lo:5: 00002000:00080000:1.0:1788305461.516966:0:8435:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788305461.516969:0:8435:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788305461.517213:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9966:x1875174015158144:12345-0@lo:5: Request processed in 272us (1327us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788305461.517219:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305461.525180:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba6c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788305461.525233:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015158016/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.525251:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9961:1875174015158016:0@lo:5: 00000004:00080000:1.0:1788305461.525268:0:9961:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788305461.527968:0:9961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9961:1875174015158272:0@lo:900: 00000100:00100000:1.0:1788305461.528035:0:9961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.528068:0:9961:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891af32ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305461.529761:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89d80 going to sleep for 11 seconds 00010000:00080000:1.0:1788305461.529806:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2d80 x1875174015158144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.529823:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158144:0@lo:5: 00000004:00080000:1.0:1788305461.529838:0:9966:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788305461.529872:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158400:0@lo:700: 00000100:00100000:1.0:1788305461.529919:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.529956:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.530019:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158400 00000100:00100000:2.0:1788305461.530027:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158400 00000100:00100000:2.0:1788305461.530082:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305461.530093:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9966:x1875174015158400:12345-0@lo:700: 00000100:00100000:2.0:1788305461.531329:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158272 00000100:00100000:2.0:1788305461.531337:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158272 00000100:00100000:2.0:1788305461.531385:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305461.531403:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9961:x1875174015158272:12345-0@lo:900: 00000100:00100000:2.0:1788305461.531494:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9961:x1875174015158272:12345-0@lo:900: Request processed in 101us (3459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305461.531501:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788305461.533855:0:9961:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357100 x1875174015158272/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305461.533907:0:9961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9961:1875174015158272:0@lo:900: 00000001:00080000:2.0:1788305461.537958:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:2.0:1788305461.537975:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1788305461.538150:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9966:x1875174015158400:12345-0@lo:700: Request processed in 8055us (8226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.538163:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788305461.538702:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015158400/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.538715:0:9966:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788305461.538731:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158400:0@lo:700: 00000004:02000040:2.0:1788305461.541460:0:9966:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788305461.548736:0:9966:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158528:0@lo:5: 00000100:00100000:3.0:1788305461.548810:0:9966:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305461.548862:0:9966:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305461.549379:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158528 00000100:00100000:2.0:1788305461.549388:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158528 00000100:00100000:2.0:1788305461.549459:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305461.549469:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9966:x1875174015158528:12345-0@lo:5: 00002000:00080000:2.0:1788305461.573960:0:8437:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788305461.573983:0:8437:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788305461.581962:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9966:x1875174015158528:12345-0@lo:5: Request processed in 32486us (33145us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788305461.581977:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788305461.591793:0:9966:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3a8380 x1875174015158528/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305477 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305461.591814:0:9966:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9966:1875174015158528:0@lo:5: 00000004:00080000:3.0:1788305461.591831:0:9966:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:3.0:1788305461.732637:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305461.732679:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015158656:0@lo:13: 00000100:00100000:3.0:1788305461.732802:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305461.732857:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158656 00000100:00100000:0.0:1788305461.732868:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158656 00000100:00100000:0.0:1788305461.732935:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788305461.732948:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015158656:12345-0@lo:13: 00002000:00000024:0.0:1788305461.732989:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305461.733067:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015158656:12345-0@lo:13: Request processed in 121us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305461.733076:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788305461.733123:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3aad80 x1875174015158656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305461.733148:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015158656:0@lo:13: 00000100:00100000:1.0:1788305461.748396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305461.748447:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015158784:0@lo:13: 00000100:00100000:1.0:1788305461.748567:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305461.748844:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158784 00000100:00100000:1.0:1788305461.748856:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158784 00000100:00100000:1.0:1788305461.749433:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788305461.749458:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015158784:12345-0@lo:13: 00002000:00000024:1.0:1788305461.749495:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305461.749574:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015158784:12345-0@lo:13: Request processed in 120us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305461.749582:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788305461.749690:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015158784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305461.749714:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015158784:0@lo:13: 00000001:00080000:0.0:1788305461.936919:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1788305462.357457:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305463.382607:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305463.774233:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305463.774269:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015158912:0@lo:41: 00000100:00100000:3.0:1788305463.774377:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305463.774530:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015158912 00000100:00100000:2.0:1788305463.774545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015158912 00000100:00100000:3.0:1788305463.774609:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015159040:0@lo:41: 00000100:00100000:2.0:1788305463.774627:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305463.774644:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015158912:12345-0@lo:41: 00000100:00100000:3.0:1788305463.774653:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305463.774700:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159040 00000100:00100000:3.0:1788305463.774709:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159040 00000004:00000024:2.0:1788305463.774720:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305463.774755:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788305463.774765:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015159040:12345-0@lo:41: 00000004:00000024:3.0:1788305463.774799:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305463.774859:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015159040:12345-0@lo:41: Request processed in 94us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305463.774866:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788305463.774909:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015159040:0@lo:41: 00000100:00100000:2.0:1788305463.775470:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015158912:12345-0@lo:41: Request processed in 829us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305463.775480:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788305463.775834:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015158912:0@lo:41: 00010000:00010000:0.0:1788305464.406450:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305464.423596:0:10040:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305464.424986:0:10040:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305465.432246:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305465.575202:0:10088:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305465.575217:0:10088:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:2.0:1788305466.289679:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305466.289838:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994135680 00000100:00100000:1.0:1788305466.289852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994135680 00000100:00100000:1.0:1788305466.289923:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:1.0:1788305466.289935:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2394:x1875173994135680:12345-192.168.202.55@tcp:250: 00010000:00080000:1.0:1788305466.289973:0:6513:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 821845f3-84a8-4b1d-9b9a-704a9fd0cb91@192.168.202.55@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:1.0:1788305466.290011:0:6513:0:(genops.c:1385:class_connect()) connect: client 821845f3-84a8-4b1d-9b9a-704a9fd0cb91, cookie 0x4a426866e6053495 00000100:00080000:1.0:1788305466.290200:0:6513:0:(import.c:65:import_set_state_nolock()) ffff8891bf9ad000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305466.290321:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+5:2394:x1875173994135680:12345-192.168.202.55@tcp:250: Request processed in 387us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.290329:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:0.0:1788305466.323616:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.323743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994135808 00000100:00100000:2.0:1788305466.323756:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994135808 00000100:00100000:2.0:1788305466.323832:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:2.0:1788305466.323845:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+5:6157:x1875173994135808:12345-192.168.202.55@tcp:101: 00010000:00010000:2.0:1788305466.323868:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305466.323910:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08250 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.323946:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.323959:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 6 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.323969:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eaa00, rc 0) 00000100:00100000:2.0:1788305466.324048:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+6:6157:x1875173994135808:12345-192.168.202.55@tcp:101: Request processed in 206us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.324056:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:0.0:1788305466.334669:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.334849:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994135936 00000100:00100000:2.0:1788305466.334863:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994135936 00000100:00100000:2.0:1788305466.334977:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:2.0:1788305466.334991:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+6:6157:x1875173994135936:12345-192.168.202.55@tcp:501: 00000100:00100000:2.0:1788305466.335157:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+6:6157:x1875173994135936:12345-192.168.202.55@tcp:501: Request processed in 169us (506us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305466.335167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:0.0:1788305466.341465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305466.341581:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136064 00000100:00100000:1.0:1788305466.341594:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136064 00000100:00100000:1.0:1788305466.341670:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:1.0:1788305466.341683:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+6:6157:x1875173994136064:12345-192.168.202.55@tcp:101: 00010000:00010000:1.0:1788305466.341705:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305466.341729:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08257 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.341767:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.341781:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 7 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.341795:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564e00, rc 0) 00000100:00100000:1.0:1788305466.341872:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+7:6157:x1875173994136064:12345-192.168.202.55@tcp:101: Request processed in 192us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.341897:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:0.0:1788305466.367811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.371370:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136192 00000100:00100000:2.0:1788305466.371395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136192 00000100:00100000:2.0:1788305466.371508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 185 00000100:00100000:2.0:1788305466.371523:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+7:6157:x1875173994136192:12345-192.168.202.55@tcp:501: 00000100:00100000:2.0:1788305466.371771:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6157:x1875173994136192:12345-192.168.202.55@tcp:501: Request processed in 251us (3975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.371779:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 185 00000100:00100000:0.0:1788305466.391691:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305466.391831:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136320 00000100:00100000:3.0:1788305466.391845:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136320 00000100:00100000:3.0:1788305466.391938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 186 00000100:00100000:3.0:1788305466.391951:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6157:x1875173994136320:12345-192.168.202.55@tcp:503: 00000100:00100000:3.0:1788305466.392145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6157:x1875173994136320:12345-192.168.202.55@tcp:503: Request processed in 196us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.392155:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 186 00000100:00100000:0.0:1788305466.404960:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305466.405135:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136448 00000100:00100000:1.0:1788305466.405148:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136448 00000100:00100000:1.0:1788305466.405233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:1.0:1788305466.405246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6175:x1875173994136448:12345-192.168.202.55@tcp:502: 00000100:00100000:1.0:1788305466.405759:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6175:x1875173994136448:12345-192.168.202.55@tcp:502: Request processed in 515us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.405769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:0.0:1788305466.448499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305466.450052:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136576 00000100:00100000:3.0:1788305466.450075:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136576 00000100:00100000:3.0:1788305466.450267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:3.0:1788305466.450365:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6175:x1875173994136576:12345-192.168.202.55@tcp:502: 00000100:00100000:3.0:1788305466.450635:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6175:x1875173994136576:12345-192.168.202.55@tcp:502: Request processed in 278us (2151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.450644:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 188 00010000:00010000:1.0:1788305466.462064:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305466.463560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305466.464476:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136704 00000100:00100000:1.0:1788305466.464491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136704 00000100:00100000:1.0:1788305466.464590:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:1.0:1788305466.464603:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6157:x1875173994136704:12345-192.168.202.55@tcp:101: 00010000:00010000:1.0:1788305466.464626:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305466.464649:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565000/0x4a426866e60534aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08288 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.464685:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565000/0x4a426866e60534aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08288 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.464699:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565000/0x4a426866e60534aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08288 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305466.464711:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565000, rc 0) 00000100:00100000:1.0:1788305466.464794:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6157:x1875173994136704:12345-192.168.202.55@tcp:101: Request processed in 193us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.464803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:0.0:1788305466.491696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305466.492000:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136832 00000100:00100000:3.0:1788305466.492013:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136832 00000100:00100000:3.0:1788305466.492092:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:3.0:1788305466.492105:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6157:x1875173994136832:12345-192.168.202.55@tcp:256: 20000000:01000000:3.0:1788305466.492140:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788305466.492172:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788305466.492183:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788305466.492186:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788305466.492190:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788305466.492192:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788305466.496659:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6157:x1875173994136832:12345-192.168.202.55@tcp:256: Request processed in 4539us (4965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.496679:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:0.0:1788305466.503881:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.504138:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994136960 00000100:00100000:2.0:1788305466.504153:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994136960 00000100:00100000:2.0:1788305466.504425:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:2.0:1788305466.504439:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6157:x1875173994136960:12345-192.168.202.55@tcp:101: 00010000:00010000:2.0:1788305466.504461:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305466.504700:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0828f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.504742:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.504756:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305466.504768:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305466.509070:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6157:x1875173994136960:12345-192.168.202.55@tcp:101: Request processed in 426us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.509092:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:0.0:1788305466.522600:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305466.522797:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137088 00000100:00100000:3.0:1788305466.522815:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137088 00000100:00100000:3.0:1788305466.522907:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:3.0:1788305466.522920:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6157:x1875173994137088:12345-192.168.202.55@tcp:501: 00000100:00100000:3.0:1788305466.523130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6157:x1875173994137088:12345-192.168.202.55@tcp:501: Request processed in 211us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.523138:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:0.0:1788305466.527134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.527601:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137216 00000100:00100000:2.0:1788305466.527618:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137216 00000100:00100000:2.0:1788305466.527756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:2.0:1788305466.527770:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6157:x1875173994137216:12345-192.168.202.55@tcp:503: 00000100:00100000:2.0:1788305466.528030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6157:x1875173994137216:12345-192.168.202.55@tcp:503: Request processed in 261us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.528039:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:0.0:1788305466.543767:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305466.543891:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137344 00000100:00100000:1.0:1788305466.543903:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137344 00000100:00100000:1.0:1788305466.543975:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:1.0:1788305466.543991:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6180:x1875173994137344:12345-192.168.202.55@tcp:502: 00000100:00100000:1.0:1788305466.544200:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6180:x1875173994137344:12345-192.168.202.55@tcp:502: Request processed in 212us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305466.544209:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:0.0:1788305466.551676:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.552378:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137472 00000100:00100000:2.0:1788305466.552394:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137472 00000100:00100000:2.0:1788305466.552687:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:2.0:1788305466.552708:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6180:x1875173994137472:12345-192.168.202.55@tcp:502: 00000100:00100000:2.0:1788305466.553020:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6180:x1875173994137472:12345-192.168.202.55@tcp:502: Request processed in 317us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.553032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:0.0:1788305466.568921:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305466.568986:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305466.569118:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137600 00000100:00100000:2.0:1788305466.569133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137600 00000100:00100000:2.0:1788305466.569189:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137856 00000100:00100000:2.0:1788305466.569193:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137856 00000100:00100000:2.0:1788305466.569209:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788305466.569218:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994137600:12345-192.168.202.55@tcp:38: 00010000:00080000:2.0:1788305466.569257:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:2.0:1788305466.569364:0:6520:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e60534b8 00000004:00100000:2.0:1788305466.569408:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788305466.570260:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8891bf943800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305466.571733:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994137600:12345-192.168.202.55@tcp:38: Request processed in 2502us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.571750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:2.0:1788305466.571804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:2.0:1788305466.571816:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994137856:12345-192.168.202.55@tcp:38: 00010000:00080000:2.0:1788305466.571855:0:6520:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:2.0:1788305466.571924:0:6520:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e60534bf 00000004:00100000:2.0:1788305466.571957:0:6520:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788305466.575506:0:6520:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305466.575640:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994137856:12345-192.168.202.55@tcp:38: Request processed in 3818us (6646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.575656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:2.0:1788305466.837616:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015159168:0@lo:13: 00000100:00100000:2.0:1788305466.837725:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.837967:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159168 00000100:00100000:1.0:1788305466.837979:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159168 00000100:00100000:3.0:1788305466.837990:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015159296:0@lo:13: 00000100:00100000:3.0:1788305466.838048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305466.838061:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159296 00000100:00100000:1.0:1788305466.838066:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159296 00000100:00100000:1.0:1788305466.838089:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788305466.838128:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015159168:12345-0@lo:13: 00002000:00000024:1.0:1788305466.838166:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305466.838239:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb487100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015159168:12345-0@lo:13: Request processed in 120us (512us total) trans 0 rc 0/0 00010000:00080000:2.0:1788305466.838318:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb484000 x1875174015159168/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305466.838334:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788305466.838367:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015159168:0@lo:13: 00000100:00080000:0.0:1788305466.847299:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305466.847314:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015159680:0@lo:400: 00000100:00080000:0.0:1788305466.847316:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305466.847359:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015159424:0@lo:400: 00000100:00100000:2.0:1788305466.847443:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847444:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847513:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015159936:0@lo:400: 00000100:00100000:0.0:1788305466.847542:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847562:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160448:0@lo:400: 00000100:00100000:0.0:1788305466.847588:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847609:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160960:0@lo:13: 00000100:00100000:0.0:1788305466.847635:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847659:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788305466.847667:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015159552:0@lo:400: 00000100:00100000:0.0:1788305466.847690:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847711:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160064:0@lo:400: 00000100:00100000:0.0:1788305466.847734:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847755:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015160576:0@lo:400: 00000100:00100000:0.0:1788305466.847776:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.847823:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159680 00000100:00100000:0.0:1788305466.847834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159680 00000100:00100000:0.0:1788305466.847900:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160064 00000100:00100000:0.0:1788305466.847904:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160064 00000100:00100000:0.0:1788305466.847924:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305466.847935:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015159680:12345-0@lo:400: 00000100:00100000:2.0:1788305466.847988:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015160192:0@lo:400: 00000100:00100000:0.0:1788305466.848013:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015159680:12345-0@lo:400: Request processed in 78us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848021:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305466.848039:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305466.848046:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015160064:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848080:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015160064:12345-0@lo:400: Request processed in 34us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848095:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305466.848119:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159936 00000100:00100000:0.0:1788305466.848122:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159936 00000100:00100000:0.0:1788305466.848142:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159552 00000100:00100000:0.0:1788305466.848145:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159552 00000100:00100000:0.0:1788305466.848154:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160576 00000100:00100000:0.0:1788305466.848156:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160576 00000100:00100000:0.0:1788305466.848179:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305466.848185:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015159936:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015159936:12345-0@lo:400: Request processed in 31us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305466.848233:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305466.848238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015159552:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848264:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015159552:12345-0@lo:400: Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848270:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305466.848307:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305466.848314:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015160576:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848343:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015160576:12345-0@lo:400: Request processed in 30us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848349:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788305466.848369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305466.848416:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e0000 x1875174015159552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.848434:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015159552:0@lo:400: 00000100:00100000:0.0:1788305466.848457:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160064:0@lo:400: 00010000:00080000:0.0:1788305466.848467:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb094a80 x1875174015160576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.848475:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015160576:0@lo:400: 00010000:00080000:0.0:1788305466.848486:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2d80 x1875174015159936/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.848494:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015159936:0@lo:400: 00000100:00100000:0.0:1788305466.848539:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159424 00000100:00100000:0.0:1788305466.848543:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159424 00000100:00100000:0.0:1788305466.848575:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788305466.848582:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015159424:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015159424:12345-0@lo:400: Request processed in 40us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848628:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788305466.848658:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015159424:0@lo:400: 00000100:00100000:0.0:1788305466.848701:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160448 00000100:00100000:0.0:1788305466.848705:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160448 00000100:00100000:0.0:1788305466.848739:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305466.848745:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015160448:12345-0@lo:400: 00000100:00100000:0.0:1788305466.848782:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015160448:12345-0@lo:400: Request processed in 37us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.848788:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788305466.848806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788305466.848823:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb094e00 x1875174015160448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.848846:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160448:0@lo:400: 00000100:00100000:0.0:1788305466.848909:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015159808:0@lo:13: 00000100:00100000:0.0:1788305466.848939:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.848956:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015160320:0@lo:400: 00000100:00100000:0.0:1788305466.848983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.848999:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015160832:0@lo:400: 00000100:00100000:0.0:1788305466.849017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305466.849045:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160320 00000100:00100000:0.0:1788305466.849048:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160320 00000100:00100000:0.0:1788305466.849073:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788305466.849079:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015160320:12345-0@lo:400: 00000100:00100000:0.0:1788305466.849114:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015160320:12345-0@lo:400: Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305466.849120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788305466.849135:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788305466.849151:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb096d80 x1875174015160320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.849160:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015160320:0@lo:400: 00000100:00100000:2.0:1788305466.850031:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.850083:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015160704:0@lo:400: 00000100:00100000:2.0:1788305466.850180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305466.850236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015159680:0@lo:400: 00000100:00100000:2.0:1788305466.850296:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160192 00000100:00100000:2.0:1788305466.850303:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160192 00000100:00100000:2.0:1788305466.850360:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160704 00000100:00100000:2.0:1788305466.850364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160704 00000100:00100000:2.0:1788305466.850382:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305466.850391:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015160192:12345-0@lo:400: 00000100:00100000:2.0:1788305466.850456:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015160192:12345-0@lo:400: Request processed in 65us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.850464:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788305466.850481:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305466.850487:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015160704:12345-0@lo:400: 00000100:00100000:2.0:1788305466.850519:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015160704:12345-0@lo:400: Request processed in 32us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.850526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788305466.850546:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305466.850551:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788305466.850572:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb096680 x1875174015160192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305466.850584:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015160192:0@lo:400: 00010000:00080000:2.0:1788305466.850595:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095c00 x1875174015160704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305466.850614:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015160704:0@lo:400: 00000100:00100000:2.0:1788305466.850675:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160832 00000100:00100000:2.0:1788305466.850681:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160832 00000100:00100000:2.0:1788305466.852037:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788305466.852073:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015160832:12345-0@lo:400: 00000100:00100000:3.0:1788305466.852293:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788305466.852305:0:8440:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788305466.852499:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015160960 00000100:00100000:3.0:1788305466.852507:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015160960 00000100:00100000:3.0:1788305466.852542:0:8440:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788305466.852551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015159808 00000100:00100000:3.0:1788305466.852555:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015159808 00000100:00100000:3.0:1788305466.852685:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305466.852696:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015159296:12345-0@lo:13: 00002000:00000024:3.0:1788305466.852731:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305466.852807:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015159296:12345-0@lo:13: Request processed in 113us (14759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.852836:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305466.852858:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305466.852880:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015160960:12345-0@lo:13: 00002000:00000024:3.0:1788305466.852893:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305466.852935:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015160960:12345-0@lo:13: Request processed in 71us (5298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.852942:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305466.852956:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305466.852964:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015159808:12345-0@lo:13: 00002000:00000024:3.0:1788305466.852974:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305466.853003:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015159808:12345-0@lo:13: Request processed in 40us (4062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305466.853009:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788305466.853052:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305466.853342:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb484000 x1875174015159808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.853369:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015159808:0@lo:13: 00010000:00080000:0.0:1788305466.853386:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015159296/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.853413:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015159296:0@lo:13: 00000100:00100000:2.0:1788305466.853966:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015160832:12345-0@lo:400: Request processed in 1903us (4942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305466.853977:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788305466.855814:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb097480 x1875174015160832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305466.855830:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788305466.855850:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015160832:0@lo:400: 00010000:00080000:0.0:1788305466.859632:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095880 x1875174015160960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305466.859669:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015160960:0@lo:13: 00000100:00100000:1.0:1788305466.863785:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788305467.478721:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305467.587256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305467.587362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305467.587561:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137728 00000100:00100000:3.0:1788305467.587572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137728 00000100:00100000:3.0:1788305467.587657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138112 00000100:00100000:3.0:1788305467.587661:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138112 00000100:00100000:3.0:1788305467.587680:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305467.587690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:0:x1875173994137728:12345-192.168.202.55@tcp:41: 00000004:00000024:3.0:1788305467.587725:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305467.587790:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:0:x1875173994137728:12345-192.168.202.55@tcp:41: Request processed in 102us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305467.587795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305467.587808:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305467.587812:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138112:12345-192.168.202.55@tcp:41: 00000004:00000024:3.0:1788305467.587819:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305467.587833:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138112:12345-192.168.202.55@tcp:41: Request processed in 20us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305467.587839:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00080000:0.0:1788305467.587896:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305467.592371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305467.593099:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994137984 00000100:00100000:2.0:1788305467.593111:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994137984 00000100:00100000:2.0:1788305467.593247:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788305467.593259:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:0:x1875173994137984:12345-192.168.202.55@tcp:41: 00000004:00000024:2.0:1788305467.593351:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305467.593439:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:0:x1875173994137984:12345-192.168.202.55@tcp:41: Request processed in 181us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.593448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00080000:0.0:1788305467.594243:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305467.594448:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305467.594847:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138240 00000100:00100000:1.0:1788305467.594853:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138240 00000100:00100000:1.0:1788305467.594898:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305467.594908:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138240:12345-192.168.202.55@tcp:40: 00000100:00100000:1.0:1788305467.594997:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138240:12345-192.168.202.55@tcp:40: Request processed in 90us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305467.595004:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:1.0:1788305467.602967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305467.603024:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305467.603174:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138752 00000100:00100000:3.0:1788305467.603186:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138752 00000100:00100000:3.0:1788305467.603247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:3.0:1788305467.603257:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2397:x1875173994138752:12345-192.168.202.55@tcp:400: 00000100:00100000:3.0:1788305467.603365:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2397:x1875173994138752:12345-192.168.202.55@tcp:400: Request processed in 110us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305467.603372:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:2.0:1788305467.603469:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138624 00000100:00100000:2.0:1788305467.603474:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138624 00000100:00100000:2.0:1788305467.603514:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305467.603523:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138624:12345-192.168.202.55@tcp:900: 00000100:00100000:2.0:1788305467.603562:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138624:12345-192.168.202.55@tcp:900: Request processed in 41us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.603569:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788305467.605888:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305467.605935:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305467.606333:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138368 00000100:00100000:2.0:1788305467.606342:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138368 00000100:00100000:2.0:1788305467.606385:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138496 00000100:00100000:2.0:1788305467.606397:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138496 00000100:00100000:2.0:1788305467.606430:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305467.606438:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994138368:12345-192.168.202.55@tcp:8: 00010000:00080000:2.0:1788305467.606470:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:2.0:1788305467.606515:0:8436:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e60534c6 00002000:00100000:2.0:1788305467.606528:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891/ffff8891bf99b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305467.606539:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305467.606733:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788305467.606766:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8891bf99e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305467.606833:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994138368:12345-192.168.202.55@tcp:8: Request processed in 393us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.606842:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305467.606858:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788305467.606863:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994138496:12345-192.168.202.55@tcp:8: 00010000:00080000:2.0:1788305467.606879:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:2.0:1788305467.606895:0:8436:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e60534cd 00002000:00100000:2.0:1788305467.606901:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891/ffff8891bf99a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305467.606907:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305467.607266:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305467.607317:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8891bf99d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305467.607344:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994138496:12345-192.168.202.55@tcp:8: Request processed in 480us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.607351:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788305467.609376:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305467.609749:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994138880 00000100:00100000:2.0:1788305467.609761:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994138880 00000100:00100000:2.0:1788305467.609815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788305467.609827:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138880:12345-192.168.202.55@tcp:33: 00000004:00080000:2.0:1788305467.640669:0:6522:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30256us 00000004:00200000:2.0:1788305467.704291:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788305467.704423:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6157:x1875173994138880:12345-192.168.202.55@tcp:33: Request processed in 94593us (95051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.704435:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:1.0:1788305467.926765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305467.927141:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139008 00000100:00100000:2.0:1788305467.927160:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139008 00000100:00100000:2.0:1788305467.927218:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:2.0:1788305467.927229:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6198:x1875173994139008:12345-192.168.202.55@tcp:101: 00010000:00010000:2.0:1788305467.927249:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305467.927347:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb800/0x4a426866e60534d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe082c0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927426:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927441:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927456:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305467.927501:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305467.927504:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305467.927519:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927544:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb800/0x4a426866e60534d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c0 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927561:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c0 expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305467.927579:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9700) 00010000:00010000:2.0:1788305467.927583:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305467.927586:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305467.927653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:6198:x1875173994139008:12345-192.168.202.55@tcp:101: Request processed in 425us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305467.927661:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00010000:00010000:3.0:1788305468.501480:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305468.885795:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305468.885820:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015161088:0@lo:41: 00000100:00100000:0.0:1788305468.885894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305468.886125:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161088 00000100:00100000:3.0:1788305468.886133:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161088 00000100:00100000:3.0:1788305468.886185:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305468.886263:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015161088:12345-0@lo:41: 00000004:00000024:3.0:1788305468.886320:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305468.886365:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015161088:12345-0@lo:41: Request processed in 171us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305468.886371:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788305468.886654:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015161088:0@lo:41: 00000100:00100000:0.0:1788305468.887049:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015161216:0@lo:41: 00000100:00100000:0.0:1788305468.887076:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305468.887155:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161216 00000100:00100000:1.0:1788305468.887161:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161216 00000100:00100000:1.0:1788305468.887199:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305468.887205:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015161216:12345-0@lo:41: 00000004:00000024:1.0:1788305468.887221:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305468.887255:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015161216:12345-0@lo:41: Request processed in 51us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305468.887259:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305468.887397:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015161216:0@lo:41: 00010000:00010000:1.0:1788305469.526475:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305470.257634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305470.258465:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139136 00000100:00100000:3.0:1788305470.258483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139136 00000100:00100000:3.0:1788305470.258745:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788305470.258759:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:6250:x1875173994139136:12345-192.168.202.55@tcp:41: 00000004:00000024:3.0:1788305470.258821:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305470.258951:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:6250:x1875173994139136:12345-192.168.202.55@tcp:41: Request processed in 194us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305470.258959:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305470.263427:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00080000:0.0:1788305470.264017:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305470.270522:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139264 00000100:00100000:2.0:1788305470.270551:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139264 00000100:00100000:2.0:1788305470.270655:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788305470.270668:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139264:12345-192.168.202.55@tcp:41: 00000004:00000024:2.0:1788305470.270708:0:6520:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305470.271209:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139264:12345-192.168.202.55@tcp:41: Request processed in 542us (7791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305470.271218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:0.0:1788305470.272854:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305470.279803:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305470.280087:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139392 00000100:00100000:3.0:1788305470.280101:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139392 00000100:00100000:3.0:1788305470.280217:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305470.280232:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139392:12345-192.168.202.55@tcp:13: 00002000:00000024:3.0:1788305470.280832:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305470.280951:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139392:12345-192.168.202.55@tcp:13: Request processed in 720us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305470.280962:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00080000:0.0:1788305470.281853:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305470.299675:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305470.300862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139520 00000100:00100000:3.0:1788305470.300881:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139520 00000100:00100000:3.0:1788305470.301002:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305470.301017:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139520:12345-192.168.202.55@tcp:13: 00002000:00000024:3.0:1788305470.301066:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305470.301194:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:6250:x1875173994139520:12345-192.168.202.55@tcp:13: Request processed in 180us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305470.301203:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00080000:0.0:1788305470.301527:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788305470.553234:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788305470.938029:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00010000:00010000:3.0:1788305471.575099:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305471.961503:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015161344:0@lo:13: 00000100:00100000:1.0:1788305471.961578:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.961662:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161344 00000100:00100000:1.0:1788305471.961670:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161344 00000100:00100000:1.0:1788305471.961731:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305471.961741:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015161344:12345-0@lo:13: 00002000:00000024:1.0:1788305471.961774:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305471.961823:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015161344:12345-0@lo:13: Request processed in 84us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.961830:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788305471.961851:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788305471.961880:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb228e00 x1875174015161344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305471.961898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015161344:0@lo:13: 00000100:00100000:2.0:1788305471.964173:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015161472:0@lo:13: 00000100:00100000:2.0:1788305471.964242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.964479:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015161600:0@lo:13: 00000100:00100000:1.0:1788305471.964513:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.964547:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161472 00000100:00100000:1.0:1788305471.964553:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161472 00000100:00100000:1.0:1788305471.964602:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161600 00000100:00100000:1.0:1788305471.964605:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161600 00000100:00100000:1.0:1788305471.964624:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305471.964633:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015161472:12345-0@lo:13: 00002000:00000024:1.0:1788305471.964661:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305471.964701:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015161472:12345-0@lo:13: Request processed in 68us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.964709:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305471.964735:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305471.964742:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015161600:12345-0@lo:13: 00002000:00000024:1.0:1788305471.964753:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305471.964786:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015161600:12345-0@lo:13: Request processed in 45us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.964792:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305471.964815:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015161728:0@lo:13: 00000100:00100000:1.0:1788305471.964843:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305471.964870:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305471.964874:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788305471.964897:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb228e00 x1875174015161600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305471.964917:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015161600:0@lo:13: 00000100:00100000:1.0:1788305471.964937:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161728 00000100:00100000:1.0:1788305471.964941:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161728 00000100:00100000:1.0:1788305471.964967:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305471.964974:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015161728:12345-0@lo:13: 00002000:00000024:1.0:1788305471.964983:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305471.965015:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015161728:12345-0@lo:13: Request processed in 41us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.965022:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788305471.965036:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788305471.965052:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb229c00 x1875174015161728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305471.965065:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015161728:0@lo:13: 00010000:00080000:2.0:1788305471.965217:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb484000 x1875174015161472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305471.965231:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015161472:0@lo:13: 00000100:00100000:2.0:1788305471.965560:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015161984:0@lo:400: 00000100:00100000:2.0:1788305471.965595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.965627:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161984 00000100:00100000:2.0:1788305471.965631:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161984 00000100:00100000:2.0:1788305471.965671:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305471.965677:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015161984:12345-0@lo:400: 00000100:00100000:2.0:1788305471.965711:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015161984:12345-0@lo:400: Request processed in 35us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.965717:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788305471.965746:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015161984:0@lo:400: 00000100:00100000:2.0:1788305471.965770:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305471.965776:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015162112:0@lo:400: 00000100:00100000:2.0:1788305471.965801:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.965829:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162112 00000100:00100000:2.0:1788305471.965832:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162112 00000100:00100000:2.0:1788305471.965856:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305471.965862:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015162112:12345-0@lo:400: 00000100:00100000:2.0:1788305471.965893:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015162112:12345-0@lo:400: Request processed in 32us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.965899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305471.965919:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015162112:0@lo:400: 00000100:00100000:2.0:1788305471.965953:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015162496:0@lo:400: 00000100:00100000:2.0:1788305471.965973:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.966015:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305471.966020:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015162624:0@lo:400: 00000100:00100000:2.0:1788305471.966041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305471.966057:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162496 00000100:00100000:2.0:1788305471.966060:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162496 00000100:00100000:2.0:1788305471.966081:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162624 00000100:00100000:2.0:1788305471.966083:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162624 00000100:00100000:2.0:1788305471.966095:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305471.966108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015162496:12345-0@lo:400: 00000100:00100000:2.0:1788305471.966137:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015162496:12345-0@lo:400: Request processed in 30us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.966142:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305471.966152:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305471.966157:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015162624:12345-0@lo:400: 00000100:00100000:2.0:1788305471.966176:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015162624:12345-0@lo:400: Request processed in 19us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305471.966180:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788305471.966200:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053100 x1875174015162624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305471.966209:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015162624:0@lo:400: 00000100:00100000:2.0:1788305471.966218:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015162496:0@lo:400: 00000100:00080000:1.0:1788305471.966412:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305471.966421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305471.966431:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015162240:0@lo:400: 00000100:00100000:1.0:1788305471.966456:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.966470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015162752:0@lo:400: 00000100:00100000:1.0:1788305471.966488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.966505:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788305471.966510:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015161856:0@lo:400: 00000100:00100000:1.0:1788305471.966535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.966563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015162368:0@lo:400: 00000100:00100000:1.0:1788305471.966583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.966600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015162880:0@lo:400: 00000100:00100000:1.0:1788305471.966620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305471.966637:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162240 00000100:00100000:1.0:1788305471.966641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162240 00000100:00100000:1.0:1788305471.966658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162752 00000100:00100000:1.0:1788305471.966660:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162752 00000100:00100000:1.0:1788305471.966676:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162880 00000100:00100000:1.0:1788305471.966679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162880 00000100:00100000:1.0:1788305471.966691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305471.966696:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015162240:12345-0@lo:400: 00000100:00100000:1.0:1788305471.966728:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015162240:12345-0@lo:400: Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.966735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788305471.966746:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305471.966751:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015162752:12345-0@lo:400: 00000100:00100000:1.0:1788305471.966772:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015162752:12345-0@lo:400: Request processed in 22us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.966786:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305471.966798:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305471.966804:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015162880:12345-0@lo:400: 00000100:00100000:1.0:1788305471.966830:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015162880:12345-0@lo:400: Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.966835:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305471.966852:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015161856 00000100:00100000:1.0:1788305471.966856:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015161856 00000100:00100000:1.0:1788305471.966883:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788305471.966889:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015161856:12345-0@lo:400: 00000100:00100000:1.0:1788305471.966916:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015161856:12345-0@lo:400: Request processed in 28us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.966921:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788305471.966945:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015162368 00000100:00100000:1.0:1788305471.966948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015162368 00000100:00100000:1.0:1788305471.966971:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305471.966977:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015162368:12345-0@lo:400: 00000100:00100000:1.0:1788305471.967007:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015162368:12345-0@lo:400: Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305471.967013:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788305471.967032:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305471.967035:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305471.967057:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015161856:0@lo:400: 00000100:00100000:1.0:1788305471.967066:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015162368:0@lo:400: 00010000:00080000:1.0:1788305471.967076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082051880 x1875174015162880/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305487 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305471.967098:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015162880:0@lo:400: 00000100:00100000:1.0:1788305471.967111:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015162240:0@lo:400: 00000100:00100000:1.0:1788305471.967120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015162752:0@lo:400: 00000001:00100000:3.0:1788305471.969479:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:00100000:3.0:1788305471.970364:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00010000:00010000:1.0:1788305472.597543:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305472.634955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305472.635064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305472.635100:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305472.635175:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305472.635207:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305472.635265:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139904 00000100:00100000:1.0:1788305472.635307:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139904 00000100:00100000:1.0:1788305472.635382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139776 00000100:00100000:1.0:1788305472.635386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139776 00000100:00100000:1.0:1788305472.635407:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:1.0:1788305472.635416:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994139904:12345-192.168.202.55@tcp:400: 00000100:00100000:1.0:1788305472.635491:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994139904:12345-192.168.202.55@tcp:400: Request processed in 76us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305472.635499:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:1.0:1788305472.635515:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788305472.635521:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994139776:12345-192.168.202.55@tcp:400: 00000100:00100000:1.0:1788305472.635546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994139776:12345-192.168.202.55@tcp:400: Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305472.635552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00080000:1.0:1788305472.635664:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305472.635667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305472.640602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994139648 00000100:00100000:0.0:1788305472.640615:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994139648 00000100:00100000:0.0:1788305472.640691:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00100000:0.0:1788305472.640725:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994139648:12345-192.168.202.55@tcp:400: 00000100:00100000:0.0:1788305472.640819:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994139648:12345-192.168.202.55@tcp:400: Request processed in 97us (5875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305472.640827:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00100000:2.0:1788305472.646084:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140160 00000100:00100000:2.0:1788305472.646098:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140160 00000100:00100000:2.0:1788305472.646234:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140032 00000100:00100000:2.0:1788305472.646238:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140032 00000100:00100000:3.0:1788305472.646308:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788305472.646321:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994140160:12345-192.168.202.55@tcp:400: 00000100:00100000:3.0:1788305472.646425:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994140160:12345-192.168.202.55@tcp:400: Request processed in 106us (11323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305472.646432:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00080000:1.0:1788305472.647095:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305472.647100:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305472.647444:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788305472.647456:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994140032:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788305472.647553:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994140032:12345-192.168.202.55@tcp:400: Request processed in 100us (12345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305472.647561:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000001:00100000:2.0:1788305472.984030:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:02000400:3.0:1788305473.558089:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788305473.626324:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305474.005616:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305474.005642:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015163008:0@lo:41: 00000100:00100000:3.0:1788305474.005711:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305474.005782:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163008 00000100:00100000:3.0:1788305474.005790:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163008 00000100:00100000:3.0:1788305474.005849:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305474.005859:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015163008:12345-0@lo:41: 00000004:00000024:3.0:1788305474.005894:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788305474.005942:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015163008:12345-0@lo:41: Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305474.005949:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305474.005992:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015163008:0@lo:41: 00000100:00100000:2.0:1788305474.006669:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305474.006682:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015163136:0@lo:41: 00000100:00100000:2.0:1788305474.006738:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305474.006773:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163136 00000100:00100000:2.0:1788305474.006777:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163136 00000100:00100000:2.0:1788305474.006818:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788305474.006826:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015163136:12345-0@lo:41: 00000004:00000024:2.0:1788305474.006849:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305474.006886:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015163136:12345-0@lo:41: Request processed in 61us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305474.006893:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788305474.006924:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015163136:0@lo:41: 00010000:00010000:3.0:1788305474.645409:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305475.670904:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305476.694380:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305477.079823:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015163264:0@lo:13: 00000100:00100000:1.0:1788305477.079896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.079983:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163264 00000100:00100000:1.0:1788305477.079991:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163264 00000100:00100000:1.0:1788305477.080041:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305477.080051:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015163264:12345-0@lo:13: 00002000:00000024:1.0:1788305477.080094:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305477.080136:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015163264:12345-0@lo:13: Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.080143:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788305477.080170:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788305477.080197:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb22b800 x1875174015163264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305477.080214:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015163264:0@lo:13: 00000100:00100000:3.0:1788305477.080413:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015163392:0@lo:13: 00000100:00100000:3.0:1788305477.080455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.080490:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163392 00000100:00100000:3.0:1788305477.080493:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163392 00000100:00100000:3.0:1788305477.080521:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305477.080528:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015163392:12345-0@lo:13: 00002000:00000024:3.0:1788305477.080544:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305477.080577:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015163392:12345-0@lo:13: Request processed in 50us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.080583:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788305477.080596:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788305477.080612:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890826fe300 x1875174015163392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305477.080625:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015163392:0@lo:13: 00000100:00100000:3.0:1788305477.081031:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015163520:0@lo:13: 00000100:00100000:3.0:1788305477.081072:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305477.081185:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163520 00000100:00100000:0.0:1788305477.081189:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163520 00000100:00100000:0.0:1788305477.081228:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305477.081237:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015163520:12345-0@lo:13: 00002000:00000024:0.0:1788305477.081249:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305477.081313:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015163520:12345-0@lo:13: Request processed in 67us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.081319:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788305477.081376:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788305477.081398:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095c00 x1875174015163520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305477.081411:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015163520:0@lo:13: 00000100:00100000:3.0:1788305477.086352:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015163648:0@lo:400: 00000100:00100000:3.0:1788305477.086430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.086472:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015164160:0@lo:400: 00000100:00100000:3.0:1788305477.086502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.086520:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015164672:0@lo:400: 00000100:00100000:3.0:1788305477.086548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.086584:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788305477.086590:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015164032:0@lo:400: 00000100:00100000:3.0:1788305477.086612:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.086628:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015164544:0@lo:400: 00000100:00100000:3.0:1788305477.086649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.086678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163648 00000100:00100000:3.0:1788305477.086686:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163648 00000100:00100000:3.0:1788305477.086733:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788305477.086742:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015163648:12345-0@lo:400: 00000100:00100000:3.0:1788305477.086788:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015163648:12345-0@lo:400: Request processed in 48us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.086795:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788305477.086826:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164160 00000100:00100000:3.0:1788305477.086829:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164160 00000100:00100000:3.0:1788305477.086855:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305477.086861:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015164160:12345-0@lo:400: 00000100:00100000:3.0:1788305477.086893:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015164160:12345-0@lo:400: Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.086900:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305477.086918:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164672 00000100:00100000:3.0:1788305477.086922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164672 00000100:00100000:3.0:1788305477.086951:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164032 00000100:00100000:3.0:1788305477.086955:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164032 00000100:00100000:3.0:1788305477.086967:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788305477.086973:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015164672:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087002:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015164672:12345-0@lo:400: Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087008:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788305477.087027:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305477.087033:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015164032:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015164032:12345-0@lo:400: Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788305477.087170:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164544 00000100:00100000:3.0:1788305477.087173:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164544 00000100:00100000:3.0:1788305477.087206:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305477.087212:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015164544:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087245:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015164544:12345-0@lo:400: Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087251:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788305477.087295:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305477.087310:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305477.087322:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015163904:0@lo:400: 00000100:00100000:3.0:1788305477.087349:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.087367:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015164416:0@lo:400: 00000100:00100000:3.0:1788305477.087389:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.087407:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788305477.087413:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015163776:0@lo:400: 00000100:00100000:3.0:1788305477.087432:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.087447:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015164288:0@lo:400: 00000100:00100000:3.0:1788305477.087467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.087477:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015164800:0@lo:400: 00000100:00100000:3.0:1788305477.087500:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.087519:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163904 00000100:00100000:3.0:1788305477.087529:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163904 00000100:00100000:3.0:1788305477.087555:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305477.087561:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015163904:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087596:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015163904:12345-0@lo:400: Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087602:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305477.087618:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164416 00000100:00100000:3.0:1788305477.087620:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164416 00000100:00100000:3.0:1788305477.087639:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015163776 00000100:00100000:3.0:1788305477.087641:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015163776 00000100:00100000:3.0:1788305477.087651:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164288 00000100:00100000:3.0:1788305477.087654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164288 00000100:00100000:3.0:1788305477.087666:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164800 00000100:00100000:3.0:1788305477.087668:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164800 00000100:00100000:3.0:1788305477.087683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305477.087688:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015164416:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087716:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015164416:12345-0@lo:400: Request processed in 28us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305477.087734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305477.087740:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015163776:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087763:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015163776:12345-0@lo:400: Request processed in 23us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087768:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305477.087778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305477.087784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015164288:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087808:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015164288:12345-0@lo:400: Request processed in 25us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087824:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788305477.087836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305477.087841:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015164800:12345-0@lo:400: 00000100:00100000:3.0:1788305477.087867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015164800:12345-0@lo:400: Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.087872:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788305477.087886:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305477.087889:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305477.087927:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015163776:0@lo:400: 00000100:00100000:3.0:1788305477.087937:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015164288:0@lo:400: 00010000:00080000:3.0:1788305477.087947:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083791500 x1875174015164800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305477.087956:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015164800:0@lo:400: 00000100:00100000:3.0:1788305477.087964:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015163904:0@lo:400: 00010000:00080000:3.0:1788305477.087972:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083792a00 x1875174015164416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305477.087980:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015164416:0@lo:400: 00000100:00100000:3.0:1788305477.088013:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015164032:0@lo:400: 00010000:00080000:3.0:1788305477.088024:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083793800 x1875174015164544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305477.088032:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015164544:0@lo:400: 00000100:00100000:3.0:1788305477.088040:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015163648:0@lo:400: 00000100:00100000:3.0:1788305477.088059:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015164160:0@lo:400: 00000100:00100000:0.0:1788305477.090295:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305477.090328:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015164928:0@lo:13: 00000100:00100000:0.0:1788305477.090393:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.091331:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015164672:0@lo:400: 00000100:00100000:3.0:1788305477.091381:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015164928 00000100:00100000:3.0:1788305477.091387:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015164928 00000100:00100000:3.0:1788305477.092242:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305477.092331:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015164928:12345-0@lo:13: 00002000:00000024:3.0:1788305477.092355:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305477.092441:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015164928:12345-0@lo:13: Request processed in 114us (2048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305477.092448:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788305477.092533:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb096680 x1875174015164928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305493 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305477.092550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015164928:0@lo:13: 00000020:00000080:1.0:1788305477.560794:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0f219360 20000000:00000080:1.0:1788305477.560812:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889083743400 uarg=0000000000000000 20000000:01000000:1.0:1788305477.560853:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788305477.560855:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788305477.560858:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788305477.560863:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788305477.560868:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788305477.560929:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788305477.560932:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788305477.564955:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788305477.565338:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788305477.565382:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788305477.565398:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788305477.565409:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788305477.565426:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305477.566021:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788305477.568508:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788305477.568570:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788305477.568592:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:3.0:1788305477.568610:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788305477.568613:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788305477.575649:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:3.0:1788305477.579708:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:3.0:1788305477.579742:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:3.0:1788305477.579757:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:3.0:1788305477.579770:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788305477.579774:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788305477.588100:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:3.0:1788305477.588414:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:3.0:1788305477.588444:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:3.0:1788305477.588457:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:3.0:1788305477.588468:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788305477.588471:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788305477.589016:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:3.0:1788305477.589476:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:3.0:1788305477.589493:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:3.0:1788305477.589502:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:3.0:1788305477.589512:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788305477.589543:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589558:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053376 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589563:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533a0 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589568:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533df expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589572:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533ed expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589576:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60533fb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589579:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053417 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589583:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053441 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589587:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605345d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589590:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053487 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589597:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589608:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589613:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589647:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589656:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 9 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589667:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165056:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305477.589753:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589758:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 9 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589764:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165184:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305477.589784:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589792:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 23 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589800:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165312:0@lo:104: 00000100:00100000:3.0:1788305477.589839:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305477.589882:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605345d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589888:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605345d expref: 23 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589893:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165440:0@lo:104: 00000100:00100000:3.0:1788305477.589908:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305477.589929:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589935:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 23 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589940:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165568:0@lo:104: 00000100:00100000:3.0:1788305477.589951:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305477.589960:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.589964:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 23 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.589969:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083790a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165696:0@lo:104: 00000100:00100000:3.0:1788305477.589982:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305477.589996:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.590003:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 23 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.590011:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165824:0@lo:104: 00010000:00010000:3.0:1788305477.590044:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.590052:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 23 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305477.590158:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788305477.590174:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305477.590183:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165312 00000100:00100000:2.0:1788305477.590188:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165312 00000100:00100000:2.0:1788305477.590216:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165440 00000100:00100000:2.0:1788305477.590217:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165440 00000100:00100000:2.0:1788305477.590222:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165568 00000100:00100000:2.0:1788305477.590223:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165568 00000100:00100000:2.0:1788305477.590228:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165696 00000100:00100000:2.0:1788305477.590229:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165696 00000100:00100000:2.0:1788305477.590233:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165824 00000100:00100000:2.0:1788305477.590234:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165824 00000100:00100000:2.0:1788305477.590242:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305477.590250:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+7:10335:x1875174015165312:12345-0@lo:104: 00010000:00010000:2.0:1788305477.590261:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590359:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305477.590373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+7:10335:x1875174015165312:12345-0@lo:104: Request processed in 123us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.590379:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305477.590396:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305477.590403:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:10335:x1875174015165440:12345-0@lo:104: 00010000:00010000:2.0:1788305477.590411:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590444:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305477.590448:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:10335:x1875174015165440:12345-0@lo:104: Request processed in 48us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.590454:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305477.590464:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305477.590469:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:10335:x1875174015165568:12345-0@lo:104: 00010000:00010000:2.0:1788305477.590476:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590502:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788305477.590506:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:10335:x1875174015165568:12345-0@lo:104: Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.590511:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305477.590522:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305477.590528:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:10335:x1875174015165696:12345-0@lo:104: 00010000:00010000:2.0:1788305477.590534:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590557:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788305477.590567:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:10335:x1875174015165696:12345-0@lo:104: Request processed in 40us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.590574:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788305477.590603:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305477.590610:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:10335:x1875174015165824:12345-0@lo:104: 00010000:00010000:2.0:1788305477.590616:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590635:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788305477.590637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:10335:x1875174015165824:12345-0@lo:104: Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.590641:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788305477.590654:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788305477.590659:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590664:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305477.590667:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590673:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305477.590677:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305477.590681:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305477.590703:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590714:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305477.590733:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590738:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6053487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605348e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590746:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788305477.590748:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590752:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305477.590754:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590758:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305477.590761:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305477.590764:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305477.590772:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590777:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305477.590781:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590983:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523be00/0x4a426866e605345d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053464 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.590999:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788305477.591002:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591008:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305477.591011:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591017:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305477.591023:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305477.591028:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305477.591042:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591048:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305477.591184:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591190:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a400/0x4a426866e6053441 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053448 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591196:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305477.591198:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591209:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305477.591210:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591214:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305477.591218:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305477.591221:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305477.591231:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591234:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305477.591238:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591242:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b800/0x4a426866e6053417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605341e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591249:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305477.591251:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591257:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305477.591259:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591307:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305477.591314:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305477.591320:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788305477.591338:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591343:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305477.591357:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591363:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebe00/0x4a426866e60533fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053402 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305477.591372:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305477.591373:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305477.591375:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305477.591491:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165952:0@lo:104: 00000100:00100000:3.0:1788305477.591513:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166080:0@lo:103: 00010000:00010000:1.0:1788305477.591537:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305477.591548:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015166336:0@lo:103: 00000100:00100000:3.0:1788305477.591550:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.591572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305477.591575:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166592:0@lo:103: 00000100:00100000:1.0:1788305477.591594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305477.591599:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015166464:0@lo:103: 00000100:00100000:3.0:1788305477.591607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.591623:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166080 00000100:00100000:1.0:1788305477.591628:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166080 00000100:00100000:3.0:1788305477.591630:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305477.591635:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166208:0@lo:103: 00010000:00010000:1.0:1788305477.591651:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 24 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591652:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.591666:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166336 00000100:00100000:1.0:1788305477.591669:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166336 00010000:00010000:1.0:1788305477.591679:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 25 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.591689:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166592 00000100:00100000:1.0:1788305477.591691:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166592 00010000:00010000:1.0:1788305477.591698:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 26 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.591706:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166208 00000100:00100000:1.0:1788305477.591708:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166208 00010000:00010000:1.0:1788305477.591716:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605345d expref: 27 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591723:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.591727:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305477.591733:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+27:3649:x1875174015166080:12345-0@lo:103: 00010000:00010000:1.0:1788305477.591743:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305477.591745:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60533df expref: 27 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.591754:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60533df expref: 27 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.591754:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 27 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591763:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166720:0@lo:104: 00010000:00010000:1.0:1788305477.591764:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 27 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591782:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305477.591793:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305477.591800:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 27 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.591808:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 27 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.591820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+27:3649:x1875174015166080:12345-0@lo:103: Request processed in 87us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.591827:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305477.591828:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166848:0@lo:104: 00000100:00100000:3.0:1788305477.591847:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.591862:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788305477.591863:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 26 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.591869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+26:3647:x1875174015166336:12345-0@lo:103: 00010000:00010000:3.0:1788305477.591871:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 26 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.591875:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788305477.591879:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166976:0@lo:104: 00010000:00010000:1.0:1788305477.591879:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 26 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.591887:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 26 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591896:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305477.591897:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305477.591905:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305477.591913:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+26:3647:x1875174015166336:12345-0@lo:103: Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.591918:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788305477.591923:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb000/0x4a426866e605348e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053487 expref: 26 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.591929:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788305477.591933:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165312:0@lo:104: 00000100:00100000:1.0:1788305477.591934:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015166592:12345-0@lo:103: 00010000:00010000:1.0:1788305477.591941:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788305477.591942:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165440:0@lo:104: 00010000:00010000:1.0:1788305477.591945:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 24 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.591949:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053441 expref: 24 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591956:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165568:0@lo:104: 00010000:00010000:1.0:1788305477.591963:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 23 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.591964:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083790a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165696:0@lo:104: 00000100:00100000:3.0:1788305477.591971:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165824:0@lo:104: 00010000:00010000:1.0:1788305477.591987:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523ba00/0x4a426866e6053402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60533fb expref: 23 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.591996:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305477.592030:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+22:3649:x1875174015166592:12345-0@lo:103: Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.592035:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305477.592048:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305477.592054:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015166208:12345-0@lo:103: 00010000:00010000:1.0:1788305477.592062:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305477.592065:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605345d expref: 21 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.592072:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605345d expref: 21 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.592082:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a600/0x4a426866e6053464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605345d expref: 21 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.592102:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305477.592123:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015166208:12345-0@lo:103: Request processed in 70us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.592128:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305477.592148:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305477.592172:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015166336:0@lo:103: 00000100:00100000:1.0:1788305477.592204:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166208:0@lo:103: 00000100:00100000:1.0:1788305477.592212:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166080:0@lo:103: 00000100:00100000:1.0:1788305477.592217:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015166592:0@lo:103: 00000100:00100000:0.0:1788305477.592256:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015165952 00000100:00100000:0.0:1788305477.592261:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015165952 00000100:00100000:0.0:1788305477.592314:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166720 00000100:00100000:0.0:1788305477.592318:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166720 00000100:00100000:0.0:1788305477.592329:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166848 00000100:00100000:0.0:1788305477.592332:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166848 00000100:00100000:0.0:1788305477.592339:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166976 00000100:00100000:0.0:1788305477.592341:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166976 00000100:00100000:0.0:1788305477.592352:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305477.592358:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:10335:x1875174015165952:12345-0@lo:104: 00010000:00010000:0.0:1788305477.592375:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592430:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305477.592436:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:10335:x1875174015165952:12345-0@lo:104: Request processed in 78us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.592443:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305477.592455:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305477.592461:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:10335:x1875174015166720:12345-0@lo:104: 00010000:00010000:0.0:1788305477.592468:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592495:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305477.592499:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:10335:x1875174015166720:12345-0@lo:104: Request processed in 39us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.592504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305477.592514:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305477.592519:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:10335:x1875174015166848:12345-0@lo:104: 00010000:00010000:0.0:1788305477.592525:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592547:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788305477.592551:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:10335:x1875174015166848:12345-0@lo:104: Request processed in 33us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.592556:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305477.592566:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305477.592571:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:10335:x1875174015166976:12345-0@lo:104: 00010000:00010000:0.0:1788305477.592583:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592607:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788305477.592611:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:10335:x1875174015166976:12345-0@lo:104: Request processed in 41us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.592617:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788305477.592631:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788305477.592636:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592642:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305477.592646:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592654:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305477.592661:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305477.592666:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305477.592685:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592691:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305477.592704:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592709:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889180031c00/0x4a426866e60533ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592726:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305477.592729:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592734:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305477.592736:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592742:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305477.592748:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305477.592753:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305477.592766:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592772:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305477.592779:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592786:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889180031400/0x4a426866e60533df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533e6 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592795:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305477.592798:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592813:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305477.592815:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592822:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305477.592828:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305477.592833:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305477.592845:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592851:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305477.592857:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592863:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e60533a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60533a7 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592872:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305477.592874:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592880:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305477.592882:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592898:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305477.592903:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305477.592908:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788305477.592921:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592926:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305477.592932:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592937:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e6053376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605337d expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.592951:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305477.592953:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305477.592954:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305477.592967:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015167360:0@lo:103: 00000100:00100000:0.0:1788305477.592996:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305477.593015:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305477.593020:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015167232:0@lo:103: 00000100:00100000:0.0:1788305477.593040:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305477.593061:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015166464 00000100:00100000:0.0:1788305477.593080:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015166464 00010000:00010000:0.0:1788305477.593097:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 20 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.593123:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167360 00000100:00100000:0.0:1788305477.593126:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167360 00010000:00010000:0.0:1788305477.593136:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 21 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.593145:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167232 00000100:00100000:0.0:1788305477.593147:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167232 00010000:00010000:0.0:1788305477.593156:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533df expref: 22 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.593165:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305477.593170:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+22:3647:x1875174015166464:12345-0@lo:103: 00010000:00010000:0.0:1788305477.593177:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305477.593181:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 22 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.593191:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 22 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.593203:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb200/0x4a426866e605341e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053417 expref: 22 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.593214:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305477.593237:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+21:3647:x1875174015166464:12345-0@lo:103: Request processed in 66us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.593243:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305477.593255:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788305477.593257:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305477.593261:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+20:3648:x1875174015167360:12345-0@lo:103: 00000100:00100000:1.0:1788305477.593266:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015167488:0@lo:103: 00010000:00010000:0.0:1788305477.593290:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305477.593305:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 20 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.593314:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 20 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.593317:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305477.593324:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305477.593336:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305477.593342:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015167104:0@lo:103: 00000100:00100000:0.0:1788305477.593349:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+20:3648:x1875174015167360:12345-0@lo:103: Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.593355:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305477.593366:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167488 00000100:00100000:0.0:1788305477.593369:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167488 00000100:00100000:1.0:1788305477.593377:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305477.593380:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 20 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.593390:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167104 00000100:00100000:0.0:1788305477.593393:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167104 00010000:00010000:0.0:1788305477.593402:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 21 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.593405:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015166464:0@lo:103: 00000100:00100000:0.0:1788305477.593414:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305477.593419:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015167232:12345-0@lo:103: 00010000:00010000:0.0:1788305477.593425:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788305477.593426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788305477.593429:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533df expref: 21 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.593433:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015167488:12345-0@lo:103: 00010000:00010000:0.0:1788305477.593438:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60533df expref: 21 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.593439:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305477.593444:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 21 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.593454:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 21 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.594045:0:6504:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788305477.594055:0:6504:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:0.0:1788305477.594194:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305477.594231:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015167232:12345-0@lo:103: Request processed in 811us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.594238:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305477.594257:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305477.594264:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015167104:12345-0@lo:103: 00010000:00010000:0.0:1788305477.595068:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305477.595080:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 20 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.595092:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 20 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.595105:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305477.595158:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015167104:12345-0@lo:103: Request processed in 895us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305477.595165:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305477.595255:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015167232:0@lo:103: 00000100:00100000:0.0:1788305477.595265:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015167360:0@lo:103: 00010000:00010000:0.0:1788305477.595319:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305477.595883:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015167104:0@lo:103: 00010000:00010000:1.0:1788305477.596544:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305477.596593:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+19:3649:x1875174015167488:12345-0@lo:103: Request processed in 3158us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.596601:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305477.596643:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165056:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305477.596657:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ea400/0x4a426866e60533f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60533ed expref: 18 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.596669:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165952:0@lo:104: 00010000:00010000:0.0:1788305477.596679:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519400/0x4a426866e60533e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60533df expref: 17 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.596874:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166720:0@lo:104: 00010000:00010000:0.0:1788305477.596891:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519a00/0x4a426866e60533a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60533a0 expref: 16 pid: 6514 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.596898:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166848:0@lo:104: 00010000:00010000:0.0:1788305477.596907:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ea200/0x4a426866e605337d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053376 expref: 15 pid: 6512 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.596914:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015166976:0@lo:104: 00000100:00100000:3.0:1788305477.597026:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015167488:0@lo:103: 00000100:00100000:0.0:1788305477.597320:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305477.597589:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305477.597613:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140288 00000100:00100000:0.0:1788305477.597619:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140288 00010000:00010000:0.0:1788305477.597649:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 10 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.597681:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140416 00000100:00100000:0.0:1788305477.597684:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140416 00010000:00010000:0.0:1788305477.597697:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 11 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305477.597715:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788305477.597723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994140288:12345-192.168.202.55@tcp:103: 00000100:00100000:1.0:1788305477.597727:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:0.0:1788305477.597734:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788305477.597735:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994140416:12345-192.168.202.55@tcp:103: 00010000:00010000:0.0:1788305477.597740:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 11 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.597748:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305477.597753:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 11 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.597760:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 11 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305477.597949:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1875174015165184:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305477.598099:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 11 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.598114:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eaa00/0x4a426866e605349c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08250 expref: 11 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.598125:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305477.598272:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994140416:12345-192.168.202.55@tcp:103: Request processed in 537us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.598327:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:3.0:1788305477.601659:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.606249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564e00/0x4a426866e60534a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08257 expref: 9 pid: 6513 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.606622:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305477.606634:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606873:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606881:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606885:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606890:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606894:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305477.606897:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606916:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606932:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305477.606945:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305477.606965:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.606973:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305477.606979:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519800/0x4a426866e60534e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305477.607040:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:2395:x1875173994140288:12345-192.168.202.55@tcp:103: Request processed in 9315us (9718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305477.607050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00010000:00010000:1.0:1788305477.717467:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305477.745339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305477.745377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305477.745398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305477.745437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305477.745465:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140800 00000100:00100000:2.0:1788305477.745475:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140800 00000100:00100000:2.0:1788305477.745527:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140928 00000100:00100000:2.0:1788305477.745531:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140928 00000100:00100000:2.0:1788305477.745554:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305477.745564:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140800:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788305477.745637:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140800:12345-192.168.202.55@tcp:400: Request processed in 73us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.745644:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305477.745660:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788305477.745667:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140928:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788305477.745690:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140928:12345-192.168.202.55@tcp:400: Request processed in 25us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.745695:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788305477.745712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140544 00000100:00100000:2.0:1788305477.745715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140544 00000100:00100000:2.0:1788305477.745742:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994140672 00000100:00100000:2.0:1788305477.745745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994140672 00000100:00100000:2.0:1788305477.745761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305477.745767:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994140544:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788305477.745794:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994140544:12345-192.168.202.55@tcp:400: Request processed in 27us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.745800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305477.745811:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:2.0:1788305477.745818:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140672:12345-192.168.202.55@tcp:400: 00000100:00100000:2.0:1788305477.745841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994140672:12345-192.168.202.55@tcp:400: Request processed in 24us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305477.745847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00080000:2.0:1788305477.745862:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305477.745866:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305477.745868:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305477.745876:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788305478.742462:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305478.958618:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305478.964175:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141056 00000100:00100000:1.0:1788305478.964191:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141056 00000100:00100000:1.0:1788305478.964263:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:1.0:1788305478.964329:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:6171:x1875173994141056:12345-192.168.202.55@tcp:101: 00010000:00010000:1.0:1788305478.964349:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305478.964376:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564a00/0x4a426866e60534e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe082c7 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305478.964407:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564a00/0x4a426866e60534e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c7 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305478.964420:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564a00/0x4a426866e60534e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c7 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305478.964430:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564a00, rc 0) 00000100:00100000:1.0:1788305478.964517:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141056:12345-192.168.202.55@tcp:101: Request processed in 244us (5907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305478.964540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:2.0:1788305478.967822:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305478.967899:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141184 00000100:00100000:3.0:1788305478.967908:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141184 00000100:00100000:3.0:1788305478.967956:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:3.0:1788305478.967964:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141184:12345-192.168.202.55@tcp:501: 00000100:00100000:3.0:1788305478.968122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141184:12345-192.168.202.55@tcp:501: Request processed in 158us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305478.968129:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:2.0:1788305478.974139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305478.974222:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141312 00000100:00100000:1.0:1788305478.974231:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141312 00000100:00100000:1.0:1788305478.974351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:1.0:1788305478.974361:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141312:12345-192.168.202.55@tcp:503: 00000100:00100000:1.0:1788305478.974520:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141312:12345-192.168.202.55@tcp:503: Request processed in 159us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305478.974528:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:0.0:1788305478.979143:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305478.979359:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141440 00000100:00100000:1.0:1788305478.979370:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141440 00000100:00100000:1.0:1788305478.979443:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:1.0:1788305478.979455:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6650:x1875173994141440:12345-192.168.202.55@tcp:502: 00000100:00100000:1.0:1788305478.979631:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6650:x1875173994141440:12345-192.168.202.55@tcp:502: Request processed in 179us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305478.979638:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:2.0:1788305478.984843:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305478.985771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141568 00000100:00100000:1.0:1788305478.985784:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141568 00000100:00100000:1.0:1788305478.985856:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:1.0:1788305478.985867:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6650:x1875173994141568:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305478.986031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6650:x1875173994141568:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 164us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305478.986040:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:2.0:1788305478.991543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305478.991632:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141696 00000100:00100000:3.0:1788305478.991642:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141696 00000100:00100000:3.0:1788305478.991698:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:3.0:1788305478.991707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994141696:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305478.991723:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305478.991738:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181519800/0x4a426866e60534f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe082ce expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305478.991791:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519800/0x4a426866e60534f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082ce expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305478.991802:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181519800/0x4a426866e60534f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082ce expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305478.991811:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519800, rc 0) 00000100:00100000:3.0:1788305478.991865:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994141696:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 159us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305478.991872:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:3.0:1788305478.994231:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305478.994471:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141824 00000100:00100000:1.0:1788305478.994481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141824 00000100:00100000:1.0:1788305478.994543:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:1.0:1788305478.994567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994141824:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305478.994727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994141824:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 162us (503us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305478.994735:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:0.0:1788305479.125664:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015167616:0@lo:41: 00000100:00100000:0.0:1788305479.125739:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.126437:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167616 00000100:00100000:2.0:1788305479.126447:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167616 00000100:00100000:2.0:1788305479.126503:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305479.126513:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015167616:12345-0@lo:41: 00000004:00000024:2.0:1788305479.126549:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305479.126605:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015167616:12345-0@lo:41: Request processed in 94us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.126610:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788305479.126768:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015167616:0@lo:41: 00000100:00100000:0.0:1788305479.127368:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305479.127379:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015167744:0@lo:41: 00000100:00100000:0.0:1788305479.127423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.127557:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167744 00000100:00100000:3.0:1788305479.127563:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167744 00000100:00100000:3.0:1788305479.127594:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788305479.127600:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015167744:12345-0@lo:41: 00000004:00000024:3.0:1788305479.127616:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305479.127652:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015167744:12345-0@lo:41: Request processed in 53us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.127656:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305479.127773:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015167744:0@lo:41: 10000000:01000000:2.0:1788305479.510656:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788305479.510664:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889082750000 from 48 10000000:01000000:2.0:1788305479.510670:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305479.510722:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.510734:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.510745:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.510770:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015167872:0@lo:101: 00000100:00100000:2.0:1788305479.510856:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.510928:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.511108:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015167872 00000100:00100000:0.0:1788305479.511116:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015167872 00000100:00100000:0.0:1788305479.511180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788305479.511192:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+15:6516:x1875174015167872:12345-0@lo:101: 00010000:00010000:0.0:1788305479.511206:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305479.511221:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523aa00/0x4a426866e60534fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60534f7 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.511270:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523aa00/0x4a426866e60534fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60534f7 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.511338:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523aa00/0x4a426866e60534fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60534f7 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.511347:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523aa00, rc 0) 00000100:00100000:0.0:1788305479.511400:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015167872:12345-0@lo:101: Request processed in 210us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.511407:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788305479.511597:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015167872:0@lo:101: 00010000:00010000:2.0:1788305479.511621:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.511630:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.511703:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168000:0@lo:501: 00000100:00100000:2.0:1788305479.511731:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.511766:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.511999:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168000 00000100:00100000:3.0:1788305479.512005:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168000 00000100:00100000:3.0:1788305479.512045:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788305479.512053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015168000:12345-0@lo:501: 00000100:00100000:3.0:1788305479.512177:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015168000:12345-0@lo:501: Request processed in 125us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.512185:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788305479.512318:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168000:0@lo:501: 00000100:00100000:2.0:1788305479.512346:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168128:0@lo:503: 00000100:00100000:2.0:1788305479.512384:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.512412:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.513663:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168128 00000100:00100000:1.0:1788305479.513673:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168128 00000100:00100000:1.0:1788305479.513731:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788305479.513741:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015168128:12345-0@lo:503: 00000100:00100000:1.0:1788305479.513887:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015168128:12345-0@lo:503: Request processed in 147us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.513895:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788305479.514120:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168128:0@lo:503: 00000100:00100000:1.0:1788305479.518797:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10353:1875174015168256:0@lo:502: 00000100:00100000:1.0:1788305479.524231:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.524315:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.525734:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168256 00000100:00100000:0.0:1788305479.525746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168256 00000100:00100000:0.0:1788305479.525813:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788305479.525825:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:10353:x1875174015168256:12345-0@lo:502: 00000100:00100000:0.0:1788305479.526018:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+16:10353:x1875174015168256:12345-0@lo:502: Request processed in 195us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.526026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788305479.526132:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10353:1875174015168256:0@lo:502: 00000100:00100000:2.0:1788305479.526197:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10353:1875174015168384:0@lo:502: 00000100:00100000:2.0:1788305479.526240:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.526307:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.526359:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168384 00000100:00100000:1.0:1788305479.526364:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168384 00000100:00100000:1.0:1788305479.526397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788305479.526404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:10353:x1875174015168384:12345-0@lo:502: 00000100:00100000:1.0:1788305479.526488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:10353:x1875174015168384:12345-0@lo:502: Request processed in 84us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.526494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788305479.526651:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10353:1875174015168384:0@lo:502: 00000040:00080000:2.0:1788305479.526669:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788305479.527106:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788305479.527129:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305479.527139:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.527159:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305479.527168:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788305479.527170:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788305479.527173:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788305479.527198:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.527207:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.527215:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305479.527229:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168512:0@lo:101: 00000100:00100000:1.0:1788305479.527261:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.527328:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.527404:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168512 00000100:00100000:2.0:1788305479.527409:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168512 00000100:00100000:2.0:1788305479.527445:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788305479.527452:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+16:6516:x1875174015168512:12345-0@lo:101: 00010000:00010000:2.0:1788305479.527463:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305479.527483:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb800/0x4a426866e605350c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053505 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.527504:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb800/0x4a426866e605350c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053505 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.527514:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb800/0x4a426866e605350c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053505 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.527523:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb800, rc 0) 00000100:00100000:2.0:1788305479.527557:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015168512:12345-0@lo:101: Request processed in 105us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.527563:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788305479.527884:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168512:0@lo:101: 00010000:00010000:1.0:1788305479.527896:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.527905:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305479.527954:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168640:0@lo:501: 00000100:00100000:1.0:1788305479.527979:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.528010:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.528103:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168640 00000100:00100000:2.0:1788305479.528108:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168640 00000100:00100000:2.0:1788305479.528125:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788305479.528131:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015168640:12345-0@lo:501: 00000100:00100000:2.0:1788305479.528246:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015168640:12345-0@lo:501: Request processed in 114us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.528253:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788305479.528456:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168640:0@lo:501: 00000100:00100000:1.0:1788305479.528481:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168768:0@lo:503: 00000100:00100000:1.0:1788305479.528517:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.528545:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.528728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168768 00000100:00100000:2.0:1788305479.528732:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168768 00000100:00100000:2.0:1788305479.528762:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788305479.528769:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015168768:12345-0@lo:503: 00000100:00100000:2.0:1788305479.528852:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015168768:12345-0@lo:503: Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.528859:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788305479.529096:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015168768:0@lo:503: 00000100:00100000:3.0:1788305479.529472:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10354:1875174015168896:0@lo:502: 00000100:00100000:3.0:1788305479.529513:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.529541:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.529589:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015168896 00000100:00100000:0.0:1788305479.529594:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015168896 00000100:00100000:0.0:1788305479.529623:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788305479.529630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:10354:x1875174015168896:12345-0@lo:502: 00000100:00100000:0.0:1788305479.529724:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+17:10354:x1875174015168896:12345-0@lo:502: Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.529731:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788305479.529839:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10354:1875174015168896:0@lo:502: 00000020:01000000:3.0:1788305479.529863:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305479.529871:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305479.529873:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788305479.529877:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788305479.529898:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10354:1875174015169024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.529930:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.529953:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.530021:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169024 00000100:00100000:2.0:1788305479.530025:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169024 00000100:00100000:2.0:1788305479.530060:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788305479.530067:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:10354:x1875174015169024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.530137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+17:10354:x1875174015169024:12345-0@lo:502:llog_process_th.0 Request processed in 71us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.530144:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788305479.530214:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10354:1875174015169024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305479.530232:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305479.530237:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305479.530238:0:10354:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788305479.530241:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788305479.530408:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788305479.530516:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788305479.530527:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.530536:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305479.530546:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788305479.530549:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891b9152800 from 48 10000000:01000000:2.0:1788305479.530552:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305479.530574:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.530581:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.530589:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.530601:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.530627:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.530655:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.530742:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169152 00000100:00100000:1.0:1788305479.530747:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169152 00000100:00100000:1.0:1788305479.530781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788305479.530788:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+17:6516:x1875174015169152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.530797:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.530810:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565400/0x4a426866e605351a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053513 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.530830:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565400/0x4a426866e605351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053513 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.530839:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565400/0x4a426866e605351a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053513 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.530846:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565400, rc 0) 00000100:00100000:1.0:1788305479.530881:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.530886:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788305479.531349:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.531374:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.531384:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.531448:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.531475:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.531498:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.531828:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169280 00000100:00100000:1.0:1788305479.531834:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169280 00000100:00100000:1.0:1788305479.531868:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788305479.531875:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305479.531996:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.532002:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788305479.532149:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.532180:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.532218:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.532239:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.532340:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169408 00000100:00100000:2.0:1788305479.532344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169408 00000100:00100000:2.0:1788305479.532374:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788305479.532381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.532473:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.532479:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788305479.532619:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.533025:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10355:1875174015169536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.533064:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.533096:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.533143:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169536 00000100:00100000:0.0:1788305479.533149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169536 00000100:00100000:0.0:1788305479.533184:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788305479.533199:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:10355:x1875174015169536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.533317:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+18:10355:x1875174015169536:12345-0@lo:502:llog_process_th.0 Request processed in 119us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.533324:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788305479.533409:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10355:1875174015169536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.533470:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10355:1875174015169664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.533501:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.533523:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.533630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169664 00000100:00100000:1.0:1788305479.533634:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169664 00000100:00100000:1.0:1788305479.533665:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788305479.533672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:10355:x1875174015169664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305479.533752:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:10355:x1875174015169664:12345-0@lo:502:llog_process_th.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.533759:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788305479.533940:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10355:1875174015169664:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788305479.533961:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788305479.534092:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788305479.534115:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305479.534125:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.534136:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305479.534146:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788305479.534149:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788305479.534152:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305479.534176:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.534190:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.534200:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.534216:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.534245:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.534305:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14480 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.534353:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169792 00000100:00100000:1.0:1788305479.534357:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169792 00000100:00100000:1.0:1788305479.534386:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788305479.534393:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+18:6516:x1875174015169792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.534401:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.534413:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565a00/0x4a426866e6053528 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053521 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.534433:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565a00/0x4a426866e6053528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053521 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.534443:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565a00/0x4a426866e6053528 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053521 expref: 19 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.534452:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565a00, rc 0) 00000100:00100000:1.0:1788305479.534488:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015169792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.534503:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788305479.534637:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.534649:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.534659:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.534706:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.534733:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.534763:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14480 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.534805:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015169920 00000100:00100000:3.0:1788305479.534809:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015169920 00000100:00100000:3.0:1788305479.534841:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788305479.534848:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015169920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.534955:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015169920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.534961:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788305479.535022:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015169920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.535045:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.535079:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.535099:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.535144:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170048 00000100:00100000:0.0:1788305479.535149:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170048 00000100:00100000:0.0:1788305479.535182:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788305479.535190:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015170048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.535303:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015170048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.535311:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788305479.538598:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.539599:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10356:1875174015170176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.539690:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.539730:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.539987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170176 00000100:00100000:0.0:1788305479.539994:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170176 00000100:00100000:0.0:1788305479.540044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788305479.540055:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:10356:x1875174015170176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.540194:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+19:10356:x1875174015170176:12345-0@lo:502:llog_process_th.0 Request processed in 140us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.540201:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788305479.540333:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10356:1875174015170176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305479.540359:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305479.540370:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305479.540372:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305479.540378:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788305479.540400:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10356:1875174015170304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305479.540435:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.540462:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.542103:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170304 00000100:00100000:0.0:1788305479.542115:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170304 00000100:00100000:0.0:1788305479.542181:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788305479.542192:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:10356:x1875174015170304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.542379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:10356:x1875174015170304:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.542387:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788305479.542513:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10356:1875174015170304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305479.542546:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305479.542553:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305479.542556:0:10356:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305479.542560:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788305479.544166:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788305479.544210:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788305479.544221:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.544232:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305479.544243:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788305479.544246:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891894cd800 from 48 10000000:01000000:0.0:1788305479.544249:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788305479.544316:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.544324:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.544335:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305479.544360:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.544418:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.544462:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.544563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170432 00000100:00100000:1.0:1788305479.544570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170432 00000100:00100000:1.0:1788305479.544611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788305479.544620:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+19:6516:x1875174015170432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.544631:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.544645:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565800/0x4a426866e6053536 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605352f expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.544665:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565800/0x4a426866e6053536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605352f expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.544675:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565800/0x4a426866e6053536 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605352f expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.544697:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565800, rc 0) 00000100:00100000:1.0:1788305479.544744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015170432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.544751:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788305479.544837:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.544850:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.544859:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.544912:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.544940:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.544971:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.545009:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170560 00000100:00100000:1.0:1788305479.545014:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170560 00000100:00100000:1.0:1788305479.545044:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788305479.545051:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015170560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305479.545159:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015170560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.545167:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788305479.545229:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.545257:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.545334:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.545354:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa140c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.545451:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170688 00000100:00100000:1.0:1788305479.545455:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170688 00000100:00100000:1.0:1788305479.545485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788305479.545491:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015170688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305479.545563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015170688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.545569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788305479.545639:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015170688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.546097:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10357:1875174015170816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.546137:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.546160:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.546203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170816 00000100:00100000:1.0:1788305479.546209:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170816 00000100:00100000:1.0:1788305479.546239:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788305479.546246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:10357:x1875174015170816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305479.546397:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:10357:x1875174015170816:12345-0@lo:502:llog_process_th.0 Request processed in 150us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.546405:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788305479.546491:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10357:1875174015170816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.546531:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10357:1875174015170944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.546564:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.546598:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305479.547978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015170944 00000100:00100000:2.0:1788305479.547988:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015170944 00000100:00100000:2.0:1788305479.548037:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788305479.548046:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:10357:x1875174015170944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.548185:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:10357:x1875174015170944:12345-0@lo:502:llog_process_th.0 Request processed in 139us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305479.548199:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788305479.548328:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10357:1875174015170944:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788305479.548358:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788305479.548927:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788305479.548948:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305479.548957:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.548968:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305479.548977:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788305479.548980:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788305479.548983:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788305479.549012:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.549020:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.549030:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.549050:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.549089:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.549128:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.549172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171072 00000100:00100000:1.0:1788305479.549178:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171072 00000100:00100000:1.0:1788305479.549215:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788305479.549222:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015171072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.549232:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.549244:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564000/0x4a426866e6053544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605353d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.549265:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564000/0x4a426866e6053544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605353d expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.549310:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564000/0x4a426866e6053544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605353d expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.549319:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564000, rc 0) 00000100:00100000:1.0:1788305479.549357:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.549363:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788305479.549442:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.549455:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.549476:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.549536:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.549563:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.549590:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.549705:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171200 00000100:00100000:0.0:1788305479.549710:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171200 00000100:00100000:0.0:1788305479.549744:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788305479.549751:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.549898:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.549906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788305479.550042:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.550072:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.550114:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.550136:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.550181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171328 00000100:00100000:1.0:1788305479.550186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171328 00000100:00100000:1.0:1788305479.550206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788305479.550211:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305479.550324:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.550336:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788305479.550449:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.554574:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10358:1875174015171456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.554662:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.554699:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.555424:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171456 00000100:00100000:1.0:1788305479.555433:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171456 00000100:00100000:1.0:1788305479.555489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788305479.555499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:10358:x1875174015171456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305479.555651:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:10358:x1875174015171456:12345-0@lo:502:llog_process_th.0 Request processed in 153us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.555657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788305479.555761:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10358:1875174015171456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305479.555790:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305479.555798:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305479.555815:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788305479.555820:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788305479.555841:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10358:1875174015171584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.555874:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305479.555906:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.556200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171584 00000100:00100000:0.0:1788305479.556204:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171584 00000100:00100000:0.0:1788305479.556235:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788305479.556242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:10358:x1875174015171584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.556365:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:10358:x1875174015171584:12345-0@lo:502:llog_process_th.0 Request processed in 123us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.556370:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788305479.556468:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10358:1875174015171584:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305479.556488:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305479.556493:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305479.556495:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788305479.556499:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:2.0:1788305479.556642:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788305479.556663:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788305479.556672:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.556680:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305479.556689:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788305479.556690:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a3800 from 48 10000000:01000000:2.0:1788305479.556692:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788305479.556713:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.556718:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.556725:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.556735:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.556757:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.556788:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.557203:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171712 00000100:00100000:1.0:1788305479.557208:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171712 00000100:00100000:1.0:1788305479.557236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788305479.557243:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015171712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.557253:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.557265:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565c00/0x4a426866e6053552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605354b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.557314:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565c00/0x4a426866e6053552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605354b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.557325:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565c00/0x4a426866e6053552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605354b expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.557334:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565c00, rc 0) 00000100:00100000:1.0:1788305479.557370:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015171712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.557374:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788305479.557448:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.557461:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.557470:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.557520:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.557540:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.557562:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.557638:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171840 00000100:00100000:0.0:1788305479.557642:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171840 00000100:00100000:0.0:1788305479.557655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788305479.557659:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015171840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.557748:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015171840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.557753:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788305479.557796:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.557823:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.557851:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.557866:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.557928:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015171968 00000100:00100000:0.0:1788305479.557931:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015171968 00000100:00100000:0.0:1788305479.557943:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788305479.557947:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015171968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.558005:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015171968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 56us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.558014:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788305479.558078:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015171968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.558455:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10359:1875174015172096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.558488:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.558516:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.558887:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172096 00000100:00100000:3.0:1788305479.558891:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172096 00000100:00100000:3.0:1788305479.558911:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788305479.558916:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:10359:x1875174015172096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.558984:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:10359:x1875174015172096:12345-0@lo:502:llog_process_th.0 Request processed in 68us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.558989:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788305479.559450:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10359:1875174015172096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.559494:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10359:1875174015172224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.559530:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.559557:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.559630:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172224 00000100:00100000:3.0:1788305479.559635:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172224 00000100:00100000:3.0:1788305479.559664:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788305479.559670:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:10359:x1875174015172224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.559737:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:10359:x1875174015172224:12345-0@lo:502:llog_process_th.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.559743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788305479.559816:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10359:1875174015172224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788305479.559841:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788305479.560019:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788305479.560039:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788305479.560049:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.560059:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305479.560068:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788305479.560071:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788305479.560073:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305479.560095:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.560100:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.560107:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305479.560116:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.560135:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.560155:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.560187:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172352 00000100:00100000:1.0:1788305479.560190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172352 00000100:00100000:1.0:1788305479.560215:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788305479.560219:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015172352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.560225:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.560236:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564c00/0x4a426866e6053560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053559 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.560316:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564c00/0x4a426866e6053560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053559 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.560327:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564c00/0x4a426866e6053560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053559 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.560336:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564c00, rc 0) 00000100:00100000:1.0:1788305479.560364:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.560369:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788305479.560450:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305479.560458:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.560472:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305479.560510:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.560527:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.560544:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.560616:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172480 00000100:00100000:3.0:1788305479.560620:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172480 00000100:00100000:3.0:1788305479.560643:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788305479.560647:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.560724:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.560729:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788305479.560824:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.560843:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.560866:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.560886:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.561031:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172608 00000100:00100000:3.0:1788305479.561036:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172608 00000100:00100000:3.0:1788305479.561063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788305479.561070:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305479.561135:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.561140:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788305479.563060:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305479.563624:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10360:1875174015172736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305479.563696:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305479.563739:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788305479.563786:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172736 00000100:00100000:3.0:1788305479.563793:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172736 00000100:00100000:3.0:1788305479.563852:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788305479.563862:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:10360:x1875174015172736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305479.563985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:10360:x1875174015172736:12345-0@lo:502:llog_process_th.0 Request processed in 124us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305479.563992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788305479.564161:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10360:1875174015172736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305479.564186:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305479.564195:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305479.564198:0:10360:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788305479.564203:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788305479.564226:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10360:1875174015172864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305479.564263:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.564342:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.564404:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172864 00000100:00100000:0.0:1788305479.564408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172864 00000100:00100000:0.0:1788305479.564437:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788305479.564444:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:10360:x1875174015172864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305479.564526:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:10360:x1875174015172864:12345-0@lo:502:llog_process_th.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305479.564532:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788305479.564673:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10360:1875174015172864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305479.564691:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305479.564695:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305479.564697:0:10360:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788305479.564700:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788305479.566439:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788305479.566470:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305479.566480:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.566492:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305479.566519:0:6516:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788305479.566521:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff889186788000 from 1 10000000:01000000:0.0:1788305479.566524:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788305479.566556:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.566563:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.566573:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305479.566593:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.566645:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305479.566693:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305479.568711:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015172992 00000100:00100000:1.0:1788305479.568724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015172992 00000100:00100000:1.0:1788305479.568800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788305479.568822:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015172992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305479.568838:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305479.568855:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564600/0x4a426866e605356e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053567 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.568882:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564600/0x4a426866e605356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053567 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.568894:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564600/0x4a426866e605356e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053567 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305479.568922:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564600, rc 0) 00000100:00100000:1.0:1788305479.569000:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015172992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305479.569007:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1788305479.569098:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015172992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305479.569120:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.569130:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305479.569200:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015173120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305479.569233:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305479.569262:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305479.569499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173120 00000100:00100000:0.0:1788305479.569504:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173120 00000100:00100000:0.0:1788305479.569540:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788305479.569547:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015173120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305479.569629:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015173120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (396us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305479.569636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788305479.569884:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015173120:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788305479.569927:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788305479.569934:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305479.569942:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305479.766174:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305480.797098:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788305480.949968:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe06e8c870 20000000:00000080:0.0:1788305480.949988:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891bb361400 uarg=0000000000000000 20000000:01000000:0.0:1788305480.950540:0:10397:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788305480.950547:0:10397:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788305480.950559:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788305480.953358:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788305480.953627:0:10397:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788305480.956119:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788305480.956150:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788305480.956159:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788305480.956172:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788305480.956188:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956205:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605320a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956213:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053218 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956220:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605326c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956227:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053392 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956236:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956243:0:10397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956340:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956361:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 9 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.956376:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173248:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305480.956481:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956490:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 23 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.956498:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173376:0@lo:104: 00000100:00100000:1.0:1788305480.956539:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305480.956577:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605326c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956585:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605326c expref: 23 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.956594:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173504:0@lo:104: 00000100:00100000:1.0:1788305480.956618:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305480.956640:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956648:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 23 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.956668:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173632:0@lo:104: 00010000:00010000:1.0:1788305480.956690:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605320a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305480.956695:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605320a expref: 23 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.956700:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173760:0@lo:104: 00000100:00100000:1.0:1788305480.956710:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305480.956981:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788305480.956996:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.957005:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.957013:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173376 00000100:00100000:0.0:1788305480.957019:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173376 00000100:00100000:0.0:1788305480.957098:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173504 00000100:00100000:0.0:1788305480.957101:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173504 00000100:00100000:0.0:1788305480.957113:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173632 00000100:00100000:0.0:1788305480.957115:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173632 00000100:00100000:0.0:1788305480.957126:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173760 00000100:00100000:0.0:1788305480.957127:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173760 00000100:00100000:0.0:1788305480.957137:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305480.957143:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:10397:x1875174015173376:12345-0@lo:104: 00010000:00010000:0.0:1788305480.957153:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957203:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305480.957209:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+6:10397:x1875174015173376:12345-0@lo:104: Request processed in 66us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.957216:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305480.957233:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305480.957238:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:10397:x1875174015173504:12345-0@lo:104: 00010000:00010000:0.0:1788305480.957246:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957308:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788305480.957313:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb312c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+5:10397:x1875174015173504:12345-0@lo:104: Request processed in 76us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.957319:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305480.957362:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305480.957369:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:10397:x1875174015173632:12345-0@lo:104: 00010000:00010000:0.0:1788305480.957377:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957411:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788305480.957416:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+4:10397:x1875174015173632:12345-0@lo:104: Request processed in 49us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.957422:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305480.957435:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305480.957440:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:10397:x1875174015173760:12345-0@lo:104: 00010000:00010000:0.0:1788305480.957447:0:6503:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957471:0:6503:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788305480.957476:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:137eb269-2484-4047-a131-a502494b009f+3:10397:x1875174015173760:12345-0@lo:104: Request processed in 36us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.957481:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788305480.957504:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788305480.957509:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957517:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305480.957520:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957528:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305480.957544:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305480.957550:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305480.957577:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957584:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305480.957604:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957612:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181518800/0x4a426866e6053392 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053399 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957623:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305480.957626:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957631:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305480.957634:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957641:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305480.957647:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305480.957652:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305480.957687:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957693:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305480.957712:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957718:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a000/0x4a426866e605326c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053273 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957726:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305480.957728:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957734:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305480.957736:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957741:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305480.957746:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305480.957751:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305480.957764:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957769:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305480.957774:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957788:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e6053218 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605321f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957796:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305480.957799:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957805:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305480.957808:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957815:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305480.957819:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305480.957822:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305480.957831:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957834:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305480.957839:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957843:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a200/0x4a426866e605320a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053211 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.957850:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305480.957855:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305480.957856:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305480.957861:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305480.957865:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305480.957874:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015173888:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.957896:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.957914:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305480.957918:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015174272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.957928:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.957945:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015174016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.957956:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.957966:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305480.957968:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015174144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.957980:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305480.958001:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015173888 00000100:00100000:0.0:1788305480.958003:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015173888 00010000:00010000:0.0:1788305480.958016:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 24 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305480.958030:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174272 00000100:00100000:0.0:1788305480.958031:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174272 00010000:00010000:0.0:1788305480.958037:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605320a expref: 25 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305480.958042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174016 00000100:00100000:0.0:1788305480.958043:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174016 00010000:00010000:0.0:1788305480.958049:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605326c expref: 26 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305480.958054:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174144 00000100:00100000:0.0:1788305480.958061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174144 00010000:00010000:0.0:1788305480.958072:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 27 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305480.958086:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305480.958092:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+27:3648:x1875174015173888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305480.958100:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305480.958105:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 27 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958114:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 27 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958129:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305480.958151:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+27:3648:x1875174015173888:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.958155:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305480.958165:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305480.958169:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+26:3648:x1875174015174272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305480.958173:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305480.958176:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605320a expref: 26 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958181:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605320a expref: 26 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958187:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305480.958201:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+26:3648:x1875174015174272:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.958206:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305480.958227:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305480.958233:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+25:3649:x1875174015174016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305480.958240:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305480.958244:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605326c expref: 25 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958252:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605326c expref: 25 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958261:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305480.958323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+25:3649:x1875174015174016:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.958329:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305480.958341:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305480.958347:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015174144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305480.958354:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305480.958359:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 24 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958366:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 24 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.958376:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305480.958397:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015174144:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.958402:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305480.958458:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083757480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015174144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.958467:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015174016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.958503:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015174272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305480.958511:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015173888:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305480.960959:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889180030a00/0x4a426866e6053399 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053392 expref: 23 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.960980:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173376:0@lo:104: 00010000:00010000:1.0:1788305480.960991:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181682c00/0x4a426866e6053273 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605326c expref: 22 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.961000:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173504:0@lo:104: 00010000:00010000:1.0:1788305480.961129:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523b000/0x4a426866e605321f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053218 expref: 21 pid: 6513 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.961139:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173632:0@lo:104: 00010000:00010000:1.0:1788305480.961148:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518000/0x4a426866e6053211 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605320a expref: 20 pid: 6514 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305480.961156:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173760:0@lo:104: 00000100:00100000:1.0:1788305480.972931:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1875174015173248:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305480.972974:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305480.980768:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305480.980864:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994141952 00000100:00100000:0.0:1788305480.980875:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994141952 00010000:00010000:0.0:1788305480.980913:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305480.980961:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788305480.980970:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994141952:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305480.980986:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305480.980991:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981015:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981034:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb400/0x4a426866e60534b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0828f expref: 10 pid: 6512 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981053:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981061:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981078:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981086:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981109:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981116:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981121:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305480.981125:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981134:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981156:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305480.981167:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305480.981231:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:2395:x1875173994141952:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 261us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305480.981238:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00010000:00010000:2.0:1788305480.982633:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305480.982647:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305480.982653:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565e00/0x4a426866e6053575 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305481.407511:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305481.407520:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889082750000 from 4 10000000:01000000:2.0:1788305481.407525:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305481.407579:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305481.407592:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305481.407604:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305481.407633:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305481.407733:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305481.407811:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305481.408375:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174400 00000100:00100000:0.0:1788305481.408385:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174400 00000100:00100000:0.0:1788305481.408447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788305481.408457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015174400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305481.408472:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305481.408486:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605357c expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.408509:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605357c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.408529:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605357c expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.408538:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a200, rc 0) 00000100:00100000:0.0:1788305481.408608:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015174400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305481.408614:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788305481.408715:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305481.408731:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.408740:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305481.408809:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.408840:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.408883:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666600 going to sleep for 11 seconds 00000100:00100000:0.0:1788305481.409474:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174528 00000100:00100000:0.0:1788305481.409481:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174528 00000100:00100000:0.0:1788305481.409523:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788305481.409531:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015174528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305481.409784:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015174528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305481.409793:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788305481.410426:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.410476:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.410532:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.410613:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.413081:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174656 00000100:00100000:1.0:1788305481.413097:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174656 00000100:00100000:1.0:1788305481.413351:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788305481.413364:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015174656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.413547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015174656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.413555:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788305481.413661:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015174656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.414575:0:10410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10410:1875174015174784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.414629:0:10410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.415317:0:10410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305481.415466:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174784 00000100:00100000:0.0:1788305481.415474:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174784 00000100:00100000:0.0:1788305481.415515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788305481.415525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:10410:x1875174015174784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305481.415707:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:10410:x1875174015174784:12345-0@lo:502:llog_process_th.0 Request processed in 182us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305481.415714:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788305481.415819:0:10410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10410:1875174015174784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305481.415945:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305481.415956:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305481.415959:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305481.415966:0:10410:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889082750000 00000020:00000080:3.0:1788305481.415968:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788305481.416049:0:10410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10410:1875174015174912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.416086:0:10410:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305481.420107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015174912 00000100:00100000:0.0:1788305481.420122:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015174912 00000100:00100000:0.0:1788305481.420192:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788305481.420203:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:10410:x1875174015174912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305481.420431:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:10410:x1875174015174912:12345-0@lo:502:llog_process_th.0 Request processed in 229us (4344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305481.420439:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788305481.420900:0:10410:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.420926:0:10410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10410:1875174015174912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305481.420961:0:10410:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305481.420970:0:10410:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305481.420973:0:10410:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788305481.420978:0:10410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788305481.422260:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788305481.422331:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305481.422342:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.422354:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305481.422366:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305481.422369:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891b9152800 from 4 10000000:01000000:0.0:1788305481.422372:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305481.422412:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.422420:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.422431:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305481.422457:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305481.422531:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305481.422583:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.422701:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175040 00000100:00100000:3.0:1788305481.422711:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175040 00000100:00100000:3.0:1788305481.422761:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788305481.422770:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015175040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305481.422784:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305481.422796:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605358a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.422820:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605358a expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.422829:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605358a expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.422968:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305481.423018:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 249us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.423025:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788305481.423116:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305481.423129:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.423144:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305481.423200:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305481.423229:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305481.423257:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.423416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175168 00000100:00100000:3.0:1788305481.423421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175168 00000100:00100000:3.0:1788305481.423446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788305481.423452:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.423563:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.423569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788305481.423648:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305481.423676:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305481.423718:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305481.423780:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918893d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788305481.423875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175296 00000100:00100000:2.0:1788305481.423880:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175296 00000100:00100000:3.0:1788305481.429624:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788305481.429647:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.429824:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.429832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788305481.429959:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.432476:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10413:1875174015175424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.432556:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.432605:0:10413:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305481.432661:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175424 00000100:00100000:2.0:1788305481.432668:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175424 00000100:00100000:2.0:1788305481.432713:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788305481.432723:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:10413:x1875174015175424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305481.432840:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:10413:x1875174015175424:12345-0@lo:502:llog_process_th.0 Request processed in 118us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.432947:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10413:1875174015175424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305481.432978:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305481.432987:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305481.432989:0:10413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305481.432995:0:10413:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891b9152800 00000020:00000080:3.0:1788305481.433003:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788305481.433568:0:10413:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10413:1875174015175552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.433611:0:10413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.433628:0:10413:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918caed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305481.433812:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788305481.433921:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175552 00000100:00100000:2.0:1788305481.433926:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175552 00000100:00100000:2.0:1788305481.433963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788305481.433972:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:10413:x1875174015175552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305481.434059:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:10413:x1875174015175552:12345-0@lo:502:llog_process_th.0 Request processed in 88us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305481.434066:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788305481.434258:0:10413:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10413:1875174015175552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305481.434349:0:10413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305481.434356:0:10413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305481.434358:0:10413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788305481.434361:0:10413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788305481.434559:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788305481.434579:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305481.434589:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.434600:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305481.434625:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305481.434627:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cd800 from 4 10000000:01000000:1.0:1788305481.434630:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305481.434656:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.434664:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.434673:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305481.434688:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.434722:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.434744:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305481.434795:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175680 00000100:00100000:2.0:1788305481.434800:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175680 00000100:00100000:2.0:1788305481.434833:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788305481.434841:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015175680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305481.434929:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305481.434944:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053598 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305481.434965:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053598 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305481.434985:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053598 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305481.434993:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:2.0:1788305481.435031:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015175680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305481.435038:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788305481.435728:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305481.435744:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.435753:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305481.435824:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.437382:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.437420:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666240 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.437521:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175808 00000100:00100000:3.0:1788305481.437528:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175808 00000100:00100000:3.0:1788305481.437575:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788305481.437585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015175808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.437713:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015175808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.437720:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788305481.437763:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.437803:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.438395:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.440815:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305481.450190:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015175936 00000100:00100000:2.0:1788305481.450207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015175936 00000100:00100000:2.0:1788305481.450954:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788305481.450979:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015175936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305481.451167:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015175936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 192us (12772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305481.451176:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788305481.451323:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015175936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.458090:0:10415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10415:1875174015176064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.458501:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.458932:0:10415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.461358:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176064 00000100:00100000:3.0:1788305481.461373:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176064 00000100:00100000:3.0:1788305481.461446:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788305481.461457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:10415:x1875174015176064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.461643:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:10415:x1875174015176064:12345-0@lo:502:llog_process_th.0 Request processed in 187us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.461660:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788305481.461810:0:10415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10415:1875174015176064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305481.461870:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305481.461881:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305481.461883:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305481.461892:0:10415:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891894cd800 00000020:00000080:1.0:1788305481.461894:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305481.461995:0:10415:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10415:1875174015176192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.462055:0:10415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.462088:0:10415:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305481.464523:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176192 00000100:00100000:3.0:1788305481.464535:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176192 00000100:00100000:3.0:1788305481.464598:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788305481.464609:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:10415:x1875174015176192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305481.464780:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:10415:x1875174015176192:12345-0@lo:502:llog_process_th.0 Request processed in 172us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305481.464788:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788305481.464955:0:10415:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10415:1875174015176192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305481.465002:0:10415:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305481.465009:0:10415:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305481.465011:0:10415:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788305481.465016:0:10415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788305481.465668:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788305481.465691:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305481.465701:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.465712:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305481.465723:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305481.465726:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a3800 from 4 10000000:01000000:3.0:1788305481.465728:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305481.465759:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.465766:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305481.465775:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305481.465807:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305481.465878:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305481.465911:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb56600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.466049:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176320 00000100:00100000:1.0:1788305481.466055:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176320 00000100:00100000:1.0:1788305481.466090:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788305481.466099:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015176320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305481.466121:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305481.466136:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60535a6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.466158:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60535a6 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.466167:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60535a6 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.466184:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564400, rc 0) 00000100:00100000:1.0:1788305481.466222:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015176320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.466229:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788305481.466301:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305481.466314:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.466323:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305481.466376:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.466401:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.466420:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.466432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176448 00000100:00100000:1.0:1788305481.466435:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176448 00000100:00100000:1.0:1788305481.466457:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788305481.466464:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015176448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.466561:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015176448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.466568:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788305481.466599:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.466622:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.466662:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.466684:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.466696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176576 00000100:00100000:1.0:1788305481.466700:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176576 00000100:00100000:1.0:1788305481.466719:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788305481.466725:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015176576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.466796:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015176576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.466804:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788305481.466841:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015176576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305481.467024:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10416:1875174015176704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.467059:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.467077:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176704 00000100:00100000:1.0:1788305481.467080:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176704 00000100:00100000:1.0:1788305481.467114:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788305481.467120:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:10416:x1875174015176704:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.467187:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:10416:x1875174015176704:12345-0@lo:502:llog_process_th.0 Request processed in 66us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.467193:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788305481.467221:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.467233:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10416:1875174015176704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305481.467255:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305481.467272:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305481.467299:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788305481.467308:0:10416:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88918c9a3800 00000020:00000080:1.0:1788305481.467310:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788305481.467371:0:10416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10416:1875174015176832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.467413:0:10416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305481.467434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176832 00000100:00100000:1.0:1788305481.467438:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176832 00000100:00100000:1.0:1788305481.467461:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788305481.467468:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:10416:x1875174015176832:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305481.467526:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:10416:x1875174015176832:12345-0@lo:502:llog_process_th.0 Request processed in 59us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305481.467533:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788305481.467566:0:10416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305481.467579:0:10416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:10416:1875174015176832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788305481.467596:0:10416:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305481.467600:0:10416:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305481.467602:0:10416:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788305481.467605:0:10416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788305481.467647:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788305481.467662:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305481.467669:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305481.467678:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305481.814412:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305482.036001:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305482.036133:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142080 00000100:00100000:2.0:1788305482.036156:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142080 00000100:00100000:2.0:1788305482.036230:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 270 00000100:00100000:2.0:1788305482.036241:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:6171:x1875173994142080:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305482.036266:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305482.036310:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe082d5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305482.036342:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305482.036366:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305482.036395:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305482.036458:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994142080:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 218us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.036465:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 270 00000100:00100000:3.0:1788305482.044695:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305482.044839:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142208 00000100:00100000:1.0:1788305482.044850:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142208 00000100:00100000:1.0:1788305482.044910:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:1.0:1788305482.044921:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994142208:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305482.045154:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994142208:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 233us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305482.045178:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:2.0:1788305482.053767:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305482.054178:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142336 00000100:00100000:1.0:1788305482.054194:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142336 00000100:00100000:1.0:1788305482.054272:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00100000:1.0:1788305482.054306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994142336:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305482.054455:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6171:x1875173994142336:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 151us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305482.054465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00100000:1.0:1788305482.062342:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.062826:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142464 00000100:00100000:3.0:1788305482.062837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142464 00000100:00100000:3.0:1788305482.062910:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:3.0:1788305482.062924:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6708:x1875173994142464:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305482.063936:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6708:x1875173994142464:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 1009us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.063947:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:1.0:1788305482.075320:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.075499:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142592 00000100:00100000:3.0:1788305482.075511:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142592 00000100:00100000:3.0:1788305482.075573:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00100000:3.0:1788305482.075585:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6708:x1875173994142592:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305482.075734:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:6708:x1875173994142592:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 150us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.075743:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00100000:3.0:1788305482.197495:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305482.197513:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015176960:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305482.197569:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305482.197626:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015176960 00000100:00100000:3.0:1788305482.197632:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015176960 00000100:00100000:3.0:1788305482.197681:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305482.197690:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015176960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305482.197715:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305482.197758:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015176960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.197773:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788305482.197804:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aa300 x1875174015176960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305482.197818:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015176960:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788305482.197866:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305482.197959:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015177344:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.197983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.197996:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015177856:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198011:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198033:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015178368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198063:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305482.198068:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015177472:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198089:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198104:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015177984:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198122:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198133:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015178496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198159:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177344 00000100:00100000:2.0:1788305482.198161:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177344 00000100:00100000:2.0:1788305482.198184:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305482.198188:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015177344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198214:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015177344:12345-0@lo:400:kworker.0 Request processed in 26us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198223:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305482.198237:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177856 00000100:00100000:2.0:1788305482.198239:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177856 00000100:00100000:2.0:1788305482.198270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178368 00000100:00100000:2.0:1788305482.198273:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178368 00000100:00100000:2.0:1788305482.198312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177472 00000100:00100000:2.0:1788305482.198314:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177472 00000100:00100000:2.0:1788305482.198327:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305482.198332:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015177856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198347:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015177216:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015177856:12345-0@lo:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198369:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305482.198369:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198379:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177216 00000100:00100000:2.0:1788305482.198382:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177216 00000100:00100000:2.0:1788305482.198395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305482.198396:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015177728:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198400:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015178368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198416:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015178368:12345-0@lo:400:kworker.0 Request processed in 23us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305482.198425:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015178240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198429:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305482.198438:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177728 00000100:00100000:2.0:1788305482.198441:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177728 00000100:00100000:0.0:1788305482.198443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198453:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178240 00000100:00100000:0.0:1788305482.198454:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788305482.198455:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178240 00000100:00100000:0.0:1788305482.198459:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015177088:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198467:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788305482.198471:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015177472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198495:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015177472:12345-0@lo:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198500:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305482.198503:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015177600:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198517:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788305482.198521:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198523:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015177216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198544:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178112:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198557:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015177216:12345-0@lo:400:kworker.0 Request processed in 35us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305482.198562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198564:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305482.198575:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305482.198576:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305482.198582:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015177728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198593:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305482.198603:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015177728:12345-0@lo:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198609:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788305482.198619:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305482.198625:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015178240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198625:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015177216:0@lo:400:kworker.0 00000100:00100000:0.0:1788305482.198636:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015177728:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198647:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015178240:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198653:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305482.198654:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015178240:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198671:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177984 00000100:00100000:2.0:1788305482.198675:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177984 00000100:00100000:2.0:1788305482.198709:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178496 00000100:00100000:2.0:1788305482.198712:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178496 00000100:00100000:2.0:1788305482.198725:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178112 00000100:00100000:2.0:1788305482.198727:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178112 00000100:00100000:2.0:1788305482.198739:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305482.198746:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015177984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198774:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015177984:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198780:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305482.198790:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305482.198803:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015178496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198828:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015178496:12345-0@lo:400:kworker.0 Request processed in 26us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198833:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305482.198844:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305482.198850:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198879:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178112:12345-0@lo:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305482.198903:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177600 00000100:00100000:2.0:1788305482.198906:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177600 00000100:00100000:2.0:1788305482.198926:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305482.198932:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015177600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.198960:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015177600:12345-0@lo:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.198967:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305482.198984:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015177088 00000100:00100000:2.0:1788305482.198987:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015177088 00000100:00100000:2.0:1788305482.199009:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788305482.199015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015177088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.199041:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015177088:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305482.199047:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:2.0:1788305482.199076:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305482.199080:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305482.199082:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305482.199084:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305482.199109:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015177088:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.199118:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015177600:0@lo:400:kworker.0 00010000:00080000:2.0:1788305482.199128:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b4000 x1875174015178112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305482.199136:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178112:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.199162:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015177472:0@lo:400:kworker.0 00010000:00080000:2.0:1788305482.199172:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5f80 x1875174015177984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305482.199180:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015177984:0@lo:400:kworker.0 00010000:00080000:2.0:1788305482.199190:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b7b80 x1875174015178496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305482.199197:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015178496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305482.199206:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015177344:0@lo:400:kworker.0 00010000:00080000:2.0:1788305482.199214:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5500 x1875174015177856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305482.199220:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015177856:0@lo:400:kworker.0 00010000:00080000:2.0:1788305482.199229:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b4700 x1875174015178368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305482.199236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015178368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305482.199376:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178624 00000100:00100000:3.0:1788305482.199380:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178624 00000100:00100000:3.0:1788305482.199407:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305482.199415:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305482.199428:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305482.199468:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.199474:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788305482.199504:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083755c00 x1875174015178624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305482.199517:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305482.199927:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305482.199960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305482.200302:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178752 00000100:00100000:0.0:1788305482.200306:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178752 00000100:00100000:0.0:1788305482.200342:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305482.200349:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305482.200368:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305482.200406:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015178752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305482.200412:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305482.200678:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305482.200690:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015178880:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305482.200719:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305482.200804:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015178880 00000100:00100000:1.0:1788305482.200809:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015178880 00000100:00100000:1.0:1788305482.200842:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305482.200849:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015178880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305482.200860:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305482.200894:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015178880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305482.200899:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788305482.200927:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aa300 x1875174015178880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305482.200942:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015178880:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788305482.200967:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083755f80 x1875174015178752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305498 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305482.200991:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015178752:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305482.837776:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305482.861481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.861531:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.861566:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.861605:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.861631:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305482.861659:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142976 00000100:00100000:3.0:1788305482.861667:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142976 00000100:00100000:3.0:1788305482.861728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142848 00000100:00100000:3.0:1788305482.861731:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142848 00000100:00100000:3.0:1788305482.861754:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788305482.861764:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994142976:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305482.861868:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994142976:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 105us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.861877:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788305482.861894:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788305482.861901:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994142848:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305482.861925:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994142848:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.861931:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788305482.861948:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143232 00000100:00100000:3.0:1788305482.861952:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143232 00000100:00100000:3.0:1788305482.861978:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143104 00000100:00100000:3.0:1788305482.861980:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143104 00000100:00100000:3.0:1788305482.861999:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305482.862005:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143232:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305482.862039:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143232:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.862045:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305482.862056:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788305482.862062:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143104:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305482.862082:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143104:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 21us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305482.862088:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00080000:3.0:1788305482.862102:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305482.862106:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305482.862109:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305482.862117:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305482.862334:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994142720 00000100:00100000:1.0:1788305482.862339:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994142720 00000100:00100000:1.0:1788305482.862371:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 276 00000100:00100000:1.0:1788305482.862378:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994142720:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305482.862412:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994142720:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305482.862418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 276 00010000:00010000:0.0:1788305483.862206:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305484.245663:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305484.245695:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015179008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305484.245781:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305484.246233:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179008 00000100:00100000:2.0:1788305484.246251:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179008 00000100:00100000:2.0:1788305484.246340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305484.246349:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015179008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305484.246385:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788305484.246435:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015179008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305484.246442:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788305484.247432:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015179008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305484.247664:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305484.248440:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015179136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305484.248503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305484.254062:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179136 00000100:00100000:2.0:1788305484.254078:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179136 00000100:00100000:2.0:1788305484.254152:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788305484.254163:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015179136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305484.254199:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305484.254582:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015179136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 419us (6077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305484.254590:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305484.254690:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015179136:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788305484.885441:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305485.911708:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305486.937050:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305487.320773:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015179264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305487.320877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.320980:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179264 00000100:00100000:1.0:1788305487.320990:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179264 00000100:00100000:1.0:1788305487.321062:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788305487.321074:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015179264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305487.321110:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305487.321161:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015179264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305487.321169:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1788305487.321205:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305487.321416:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305487.321428:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015179392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305487.321462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324580:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015179520:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.324679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324727:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015180032:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.324757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324778:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015180544:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.324807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324835:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788305487.324841:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015179904:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.324884:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324905:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015180416:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.324929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305487.324970:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180032 00000100:00100000:2.0:1788305487.324981:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180032 00000100:00100000:2.0:1788305487.325039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305487.325050:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015180032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325113:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015180032:12345-0@lo:400:kworker.0 Request processed in 64us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.325121:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305487.325146:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180544 00000100:00100000:2.0:1788305487.325150:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180544 00000100:00100000:2.0:1788305487.325175:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179904 00000100:00100000:2.0:1788305487.325178:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179904 00000100:00100000:2.0:1788305487.325191:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180416 00000100:00100000:2.0:1788305487.325193:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180416 00000100:00100000:2.0:1788305487.325224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788305487.325232:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015180544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325264:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015180544:12345-0@lo:400:kworker.0 Request processed in 33us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.325270:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788305487.325311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305487.325317:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015179904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325345:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015179904:12345-0@lo:400:kworker.0 Request processed in 29us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.325350:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305487.325361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305487.325367:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015180416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325392:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015180416:12345-0@lo:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.325410:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305487.325452:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015179904:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015180416:0@lo:400:kworker.0 00000100:00100000:2.0:1788305487.325474:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015180032:0@lo:400:kworker.0 00010000:00080000:2.0:1788305487.325487:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5500 x1875174015180544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305487.325498:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015180544:0@lo:400:kworker.0 00000100:00100000:3.0:1788305487.328088:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179392 00000100:00100000:3.0:1788305487.328117:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179392 00000100:00100000:3.0:1788305487.328198:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305487.328223:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015179392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305487.328256:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305487.328374:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015179392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (6911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305487.328382:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305487.328413:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179520 00000100:00100000:3.0:1788305487.328418:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179520 00000100:00100000:3.0:1788305487.328443:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788305487.328449:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015179520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305487.328480:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015179520:12345-0@lo:400:kworker.0 Request processed in 32us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305487.328487:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788305487.328610:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015181056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305487.328644:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305487.328687:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015179520:0@lo:400:kworker.0 00010000:00080000:3.0:1788305487.328707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083757100 x1875174015179392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305487.328725:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015179392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305487.328766:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305487.328773:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015180928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305487.328799:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305487.328822:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181056 00000100:00100000:3.0:1788305487.328825:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181056 00000100:00100000:3.0:1788305487.328985:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180928 00000100:00100000:3.0:1788305487.328988:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180928 00000100:00100000:3.0:1788305487.329003:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305487.329009:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015181056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305487.329031:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305487.329063:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015181056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305487.329069:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305487.329078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305487.329084:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015180928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305487.329961:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305487.330024:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015180928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 938us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305487.330032:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788305487.330081:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aad80 x1875174015180928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305487.330321:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015179648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330368:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330396:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015180160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330419:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330438:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015180672:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330488:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788305487.330495:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015179776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330524:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330543:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015180288:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330566:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330584:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015180800:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330605:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305487.330643:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179648 00000100:00100000:1.0:1788305487.330648:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179648 00000100:00100000:1.0:1788305487.330683:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180160 00000100:00100000:1.0:1788305487.330686:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180160 00000100:00100000:1.0:1788305487.330701:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180288 00000100:00100000:1.0:1788305487.330703:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180288 00000100:00100000:1.0:1788305487.330717:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788305487.330726:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015179648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.330771:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015179648:12345-0@lo:400:kworker.0 Request processed in 46us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305487.330778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788305487.330791:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305487.330797:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015180160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305487.331197:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015180928:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788305487.331231:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a8e00 x1875174015181056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305487.331247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015181056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305487.333777:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180672 00000100:00100000:0.0:1788305487.333799:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180672 00000100:00100000:0.0:1788305487.333862:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015180800 00000100:00100000:0.0:1788305487.333864:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015180800 00000100:00100000:0.0:1788305487.333893:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305487.333903:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015180672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305487.334011:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015180672:12345-0@lo:400:kworker.0 Request processed in 109us (3547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305487.334018:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305487.334035:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305487.334041:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015180800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305487.334062:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015180800:12345-0@lo:400:kworker.0 Request processed in 22us (3457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305487.334068:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305487.334086:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305487.334285:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015180160:12345-0@lo:400:kworker.0 Request processed in 3474us (3852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305487.334295:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305487.334318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788305487.334327:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015180288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.334365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015180288:12345-0@lo:400:kworker.0 Request processed in 41us (3798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305487.334371:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788305487.334393:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015179776 00000100:00100000:1.0:1788305487.334398:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015179776 00000100:00100000:1.0:1788305487.334429:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305487.334436:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015179776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.334473:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015179776:12345-0@lo:400:kworker.0 Request processed in 37us (3948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305487.334478:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305487.334540:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015179776:0@lo:400:kworker.0 00010000:00080000:1.0:1788305487.334559:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b6a00 x1875174015180288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305487.334571:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015180288:0@lo:400:kworker.0 00010000:00080000:1.0:1788305487.334584:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b7100 x1875174015180800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305487.334591:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015180800:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.334605:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015179648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305487.334618:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015180160:0@lo:400:kworker.0 00010000:00080000:1.0:1788305487.334645:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b4700 x1875174015180672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305487.334653:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015180672:0@lo:400:kworker.0 00010000:00080000:1.0:1788305487.334727:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082050000 x1875174015179264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305503 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305487.334745:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015179264:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305487.334769:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305487.334776:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305487.334780:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305487.340414:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00010000:1.0:1788305487.957710:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305487.993543:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305487.993587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305487.993617:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305487.993638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305487.993675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305487.993712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143488 00000100:00100000:2.0:1788305487.993726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143488 00000100:00100000:2.0:1788305487.993804:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143616 00000100:00100000:2.0:1788305487.993807:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143616 00000100:00100000:2.0:1788305487.993839:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:2.0:1788305487.993851:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994143488:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305487.993957:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994143488:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 107us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.993966:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:2.0:1788305487.993986:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:2.0:1788305487.993993:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143616:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305487.994034:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143616:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.994042:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:2.0:1788305487.994064:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143744 00000100:00100000:2.0:1788305487.994068:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143744 00000100:00100000:2.0:1788305487.994098:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143872 00000100:00100000:2.0:1788305487.994101:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143872 00000100:00100000:2.0:1788305487.994122:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305487.994128:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143744:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305487.994154:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143744:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.994161:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305487.994172:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:2.0:1788305487.994178:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143872:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305487.994199:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994143872:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.994220:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00080000:2.0:1788305487.994245:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305487.994250:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305487.994253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305487.994256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305487.994487:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994143360 00000100:00100000:2.0:1788305487.994491:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994143360 00000100:00100000:2.0:1788305487.994519:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 278 00000100:00100000:2.0:1788305487.994525:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994143360:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305487.994555:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994143360:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305487.994569:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 278 00010000:00010000:1.0:1788305488.988090:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305489.366518:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305489.366541:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015181184:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305489.366611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305489.366687:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181184 00000100:00100000:2.0:1788305489.366695:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181184 00000100:00100000:2.0:1788305489.366765:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305489.366774:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015181184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305489.366808:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788305489.366856:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015181184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305489.366864:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305489.366909:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015181184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305489.367977:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015181312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305489.368026:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305489.368371:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181312 00000100:00100000:2.0:1788305489.368377:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181312 00000100:00100000:2.0:1788305489.368420:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305489.368428:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015181312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305489.368453:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305489.368494:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015181312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305489.368607:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305489.368652:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015181312:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788305489.459650:0:10698:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788305490.005513:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305491.030032:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305492.060511:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305492.458462:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305492.458550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305492.458616:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305492.458622:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015181568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305492.458646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305492.458681:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181440 00000100:00100000:3.0:1788305492.458689:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181440 00000100:00100000:3.0:1788305492.458737:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181568 00000100:00100000:3.0:1788305492.458740:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181568 00000100:00100000:3.0:1788305492.458755:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305492.458764:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015181440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305492.458793:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305492.458834:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015181440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305492.458840:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305492.458856:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305492.458862:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015181568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305492.458877:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305492.458904:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015181568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305492.458910:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788305492.458928:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305492.458932:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788305492.458961:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837ab800 x1875174015181568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305492.458992:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015181568:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788305492.459005:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aad80 x1875174015181440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305492.459015:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015181440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305492.459295:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015181696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305492.459328:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305492.459436:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305492.459444:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015181824:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305492.459469:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305492.459492:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181696 00000100:00100000:3.0:1788305492.459496:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181696 00000100:00100000:3.0:1788305492.459522:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181824 00000100:00100000:3.0:1788305492.459525:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181824 00000100:00100000:3.0:1788305492.459539:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305492.459545:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015181696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305492.459555:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305492.459585:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015181696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305492.459591:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305492.459602:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305492.459608:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015181824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305492.459616:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305492.459637:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015181824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305492.459643:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788305492.459657:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305492.459659:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788305492.459685:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aad80 x1875174015181824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305492.459698:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015181824:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788305492.459706:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268000 x1875174015181696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305492.459714:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015181696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305492.459961:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015182080:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460002:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460026:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015182592:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460048:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460067:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788305492.460073:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015181952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460098:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460121:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015182464:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460142:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460181:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015182976:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460202:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460229:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182080 00000100:00100000:0.0:1788305492.460233:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182080 00000100:00100000:0.0:1788305492.460263:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182592 00000100:00100000:0.0:1788305492.460265:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182592 00000100:00100000:0.0:1788305492.460305:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182976 00000100:00100000:0.0:1788305492.460308:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182976 00000100:00100000:0.0:1788305492.460320:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305492.460327:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015182080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460365:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015182080:12345-0@lo:400:kworker.0 Request processed in 38us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.460372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305492.460384:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305492.460391:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015182592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460417:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015182592:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.460422:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305492.460433:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305492.460438:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015182976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015182976:12345-0@lo:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.460467:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305492.460486:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015181952 00000100:00100000:0.0:1788305492.460489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015181952 00000100:00100000:0.0:1788305492.460512:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788305492.460518:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015181952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460553:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015181952:12345-0@lo:400:kworker.0 Request processed in 36us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.460559:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788305492.460582:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182464 00000100:00100000:0.0:1788305492.460586:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182464 00000100:00100000:0.0:1788305492.460606:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305492.460613:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015182464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460642:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015182464:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.460648:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305492.460687:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083757b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015181952:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460696:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015182464:0@lo:400:kworker.0 00010000:00080000:0.0:1788305492.460705:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083755c00 x1875174015182976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305492.460713:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015182976:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460720:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015182080:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460728:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015182592:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460750:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015182336:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460778:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460795:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015182848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460813:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460826:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788305492.460831:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015182208:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460858:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460875:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015182720:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.460893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305492.460914:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182336 00000100:00100000:0.0:1788305492.460917:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182336 00000100:00100000:0.0:1788305492.460934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182848 00000100:00100000:0.0:1788305492.460937:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182848 00000100:00100000:0.0:1788305492.460948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182720 00000100:00100000:0.0:1788305492.460951:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182720 00000100:00100000:0.0:1788305492.460962:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305492.460967:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015182336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015182336:12345-0@lo:400:kworker.0 Request processed in 33us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.461006:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305492.461017:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305492.461022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015182848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461046:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015182848:12345-0@lo:400:kworker.0 Request processed in 24us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.461051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788305492.461062:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305492.461068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015182720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461093:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015182720:12345-0@lo:400:kworker.0 Request processed in 26us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.461098:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788305492.461115:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015182208 00000100:00100000:0.0:1788305492.461119:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015182208 00000100:00100000:0.0:1788305492.461137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305492.461149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015182208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461195:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015182208:12345-0@lo:400:kworker.0 Request processed in 45us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305492.461200:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305492.461232:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083756680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015182208:0@lo:400:kworker.0 00010000:00080000:0.0:1788305492.461242:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083757100 x1875174015182720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305508 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305492.461251:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083757100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015182720:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461259:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015182336:0@lo:400:kworker.0 00000100:00100000:0.0:1788305492.461267:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015182848:0@lo:400:kworker.0 00000100:00080000:0.0:1788305492.461309:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305492.461313:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305493.080415:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305493.105352:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305493.105392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305493.105401:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144000 00000100:00100000:1.0:1788305493.105411:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144000 00000100:00100000:3.0:1788305493.105412:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305493.105433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305493.105461:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 280 00000100:00100000:1.0:1788305493.105471:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994144000:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305493.105498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305493.105522:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144256 00000100:00100000:3.0:1788305493.105525:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144256 00000100:00100000:1.0:1788305493.105535:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994144000:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 66us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305493.105542:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 280 00000100:00100000:3.0:1788305493.105558:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144128 00000100:00100000:3.0:1788305493.105561:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144128 00000100:00100000:3.0:1788305493.105579:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788305493.105585:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994144256:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305493.105615:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994144256:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305493.105621:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:3.0:1788305493.105633:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788305493.105640:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994144128:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305493.105669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994144128:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305493.105674:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788305493.105710:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144384 00000100:00100000:3.0:1788305493.105714:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144384 00000100:00100000:3.0:1788305493.106133:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144512 00000100:00100000:3.0:1788305493.106138:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144512 00000100:00100000:3.0:1788305493.106174:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:3.0:1788305493.106181:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994144384:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305493.106243:0:8758:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60534c6 00000100:00080000:3.0:1788305493.106255:0:8758:0:(import.c:65:import_set_state_nolock()) ffff8891bf99e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305493.106319:0:8758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788305493.106442:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+2:2394:x1875173994144384:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 260us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305493.106448:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:3.0:1788305493.106461:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:3.0:1788305493.106468:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994144512:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305493.106480:0:8758:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60534cd 00000100:00080000:3.0:1788305493.106486:0:8758:0:(import.c:65:import_set_state_nolock()) ffff8891bf99d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305493.106509:0:8758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788305493.106574:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+2:2394:x1875173994144512:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 106us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305493.106581:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00080000:3.0:1788305493.106599:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305493.106603:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305493.106605:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305493.106607:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788305493.106695:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305493.106701:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305494.102238:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305494.485501:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015183104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305494.485574:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305494.485718:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015183232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305494.485926:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183104 00000100:00100000:1.0:1788305494.485940:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183104 00000100:00100000:1.0:1788305494.485986:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788305494.485995:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015183104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305494.486027:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305494.486066:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015183104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305494.486074:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305494.486229:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015183104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305494.486260:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305494.486369:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183232 00000100:00100000:1.0:1788305494.486373:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183232 00000100:00100000:1.0:1788305494.486397:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788305494.486403:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015183232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305494.486434:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305494.488766:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015183232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2353us (2495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305494.488779:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305494.489920:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015183232:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788305494.956745:0:10942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing yml_node 00010000:00010000:1.0:1788305495.129208:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305496.149621:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305497.173591:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305497.557731:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015183616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305497.557804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305497.557863:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015184128:0@lo:400:kworker.0 00000100:00100000:2.0:1788305497.557901:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558017:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015183744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558070:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015184256:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558091:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558126:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015184768:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558146:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558173:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788305497.558179:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015183360:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558203:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558222:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015183872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558241:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558269:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015184384:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558324:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558341:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015184896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305497.558389:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184128 00000100:00100000:0.0:1788305497.558396:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184128 00000100:00100000:0.0:1788305497.558441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183744 00000100:00100000:0.0:1788305497.558444:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183744 00000100:00100000:0.0:1788305497.558465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788305497.558473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015184128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558518:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015184128:12345-0@lo:400:kworker.0 Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558526:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788305497.558542:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305497.558547:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015183744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015183744:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558583:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305497.558598:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184256 00000100:00100000:0.0:1788305497.558601:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184256 00000100:00100000:0.0:1788305497.558619:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184768 00000100:00100000:0.0:1788305497.558621:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184768 00000100:00100000:0.0:1788305497.558631:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184384 00000100:00100000:0.0:1788305497.558634:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184384 00000100:00100000:0.0:1788305497.558645:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184896 00000100:00100000:0.0:1788305497.558647:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184896 00000100:00100000:0.0:1788305497.558658:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305497.558664:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015184256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558715:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015184256:12345-0@lo:400:kworker.0 Request processed in 51us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558722:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305497.558733:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305497.558739:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015184768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558764:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015184768:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558769:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305497.558779:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305497.558785:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015184384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558806:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015184384:12345-0@lo:400:kworker.0 Request processed in 22us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558812:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305497.558821:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305497.558826:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015184896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558849:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015184896:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558855:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305497.558876:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183360 00000100:00100000:0.0:1788305497.558879:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183360 00000100:00100000:0.0:1788305497.558900:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788305497.558906:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015183360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.558948:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015183360:12345-0@lo:400:kworker.0 Request processed in 41us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.558954:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:0.0:1788305497.558993:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305497.558997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305497.559000:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305497.559031:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015183360:0@lo:400:kworker.0 00010000:00080000:0.0:1788305497.559047:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38380 x1875174015184384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.559058:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015184384:0@lo:400:kworker.0 00010000:00080000:0.0:1788305497.559067:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b7100 x1875174015184896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.559074:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015184896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.559082:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015183744:0@lo:400:kworker.0 00010000:00080000:0.0:1788305497.559090:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d3bb80 x1875174015184256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.559097:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015184256:0@lo:400:kworker.0 00010000:00080000:0.0:1788305497.559105:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5f80 x1875174015184768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.559112:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015184768:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559483:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015183488:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559519:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305497.559546:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015184000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305497.559583:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015184512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559616:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305497.559661:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183616 00000100:00100000:1.0:1788305497.559666:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183616 00000100:00100000:1.0:1788305497.559691:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183872 00000100:00100000:1.0:1788305497.559701:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183872 00000100:00100000:1.0:1788305497.559718:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788305497.559724:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015183616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559760:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015183616:12345-0@lo:400:kworker.0 Request processed in 36us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305497.559766:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788305497.559780:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305497.559786:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015183872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559818:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015183872:12345-0@lo:400:kworker.0 Request processed in 32us (1576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305497.559824:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788305497.559849:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015183488 00000100:00100000:1.0:1788305497.559852:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015183488 00000100:00100000:1.0:1788305497.559869:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184000 00000100:00100000:1.0:1788305497.559872:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184000 00000100:00100000:1.0:1788305497.559888:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184512 00000100:00100000:1.0:1788305497.559890:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184512 00000100:00100000:1.0:1788305497.559904:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305497.559910:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015183488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.559956:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015183488:12345-0@lo:400:kworker.0 Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305497.559963:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305497.559975:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305497.559981:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015184000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.560007:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015184000:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305497.560013:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305497.560030:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305497.560036:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015184512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.560064:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015184512:12345-0@lo:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305497.560070:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788305497.560086:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305497.560107:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015183488:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.560128:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015184000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.560137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015184512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305497.560162:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015183872:0@lo:400:kworker.0 00010000:00080000:2.0:1788305497.560361:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38700 x1875174015184128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305497.560373:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015184128:0@lo:400:kworker.0 00000100:00100000:2.0:1788305497.560380:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015184640:0@lo:400:kworker.0 00000100:00100000:2.0:1788305497.560405:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305497.560445:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015183616:0@lo:400:kworker.0 00000100:00100000:3.0:1788305497.560706:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305497.560722:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015185280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305497.560752:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305497.560780:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185280 00000100:00100000:3.0:1788305497.560784:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185280 00000100:00100000:3.0:1788305497.560812:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305497.560818:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015185280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305497.560839:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305497.560873:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015185280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305497.560879:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788305497.561142:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268000 x1875174015185280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305497.561158:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015185280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305497.561178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305497.561201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305497.561218:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305497.561224:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305497.561243:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305497.561263:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185024 00000100:00100000:3.0:1788305497.561266:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185024 00000100:00100000:3.0:1788305497.561473:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185152 00000100:00100000:3.0:1788305497.561477:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185152 00000100:00100000:3.0:1788305497.561493:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305497.561500:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305497.561512:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305497.561543:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305497.561558:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305497.561572:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305497.561578:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305497.561593:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305497.561621:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305497.561627:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305497.561723:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015184640 00000100:00100000:0.0:1788305497.561727:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015184640 00000100:00100000:0.0:1788305497.561761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305497.561769:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015184640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305497.561804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015184640:12345-0@lo:400:kworker.0 Request processed in 36us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305497.561810:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788305497.562236:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305497.562246:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015185408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305497.562431:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305497.562463:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185408 00000100:00100000:2.0:1788305497.562467:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185408 00000100:00100000:2.0:1788305497.562493:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305497.562499:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015185408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305497.562510:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305497.562542:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015185408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305497.562548:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788305497.562586:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5500 x1875174015185408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305497.562601:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015185408:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788305497.562629:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b6300 x1875174015184640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788305497.562746:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837ab480 x1875174015185152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.562760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185152:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788305497.562772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a9c00 x1875174015185024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305513 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305497.562784:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185024:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305497.563029:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305497.563226:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015184640:0@lo:400:kworker.0 00010000:00010000:1.0:1788305498.197532:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305498.226005:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305498.226152:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144640 00000100:00100000:1.0:1788305498.226162:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144640 00000100:00100000:1.0:1788305498.226269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:1.0:1788305498.226319:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994144640:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305498.226432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994144640:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 116us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305498.226440:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:1.0:1788305498.228208:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305498.228255:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305498.228320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144768 00000100:00100000:3.0:1788305498.228336:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144768 00000100:00080000:2.0:1788305498.228445:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305498.230574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994144896 00000100:00100000:0.0:1788305498.230814:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:0.0:1788305498.230838:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994144768:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305498.230943:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994144768:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 117us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305498.230951:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:3.0:1788305498.231063:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994144896 00000100:00100000:3.0:1788305498.232300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:3.0:1788305498.232319:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994144896:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305498.232496:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994144896:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 183us (4239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305498.232504:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00080000:0.0:1788305498.232641:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:2.0:1788305499.103987:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:2.0:1788305499.103997:0:8431:0:(genops.c:885:class_export_put()) final put ffff8891bf99b800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:3.0:1788305499.104069:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99b800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-OST0000 00000020:00000080:3.0:1788305499.104134:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf99e800 for lustre-OST0000 00000001:00100000:0.0:1788305499.105629:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:0.0:1788305499.105637:0:9516:0:(genops.c:885:class_export_put()) final put ffff8891bf99a000/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:1.0:1788305499.105713:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99a000/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-OST0001 00000020:00000080:1.0:1788305499.105762:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf99d800 for lustre-OST0001 00010000:00010000:3.0:1788305499.221460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305499.605455:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305499.605541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305499.605640:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185536 00000100:00100000:2.0:1788305499.605649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185536 00000100:00100000:2.0:1788305499.605698:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305499.605708:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305499.605746:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788305499.605818:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015185536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305499.605825:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788305499.605884:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015185536:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305499.606487:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015185664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305499.606523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305499.606649:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185664 00000100:00100000:0.0:1788305499.606654:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185664 00000100:00100000:0.0:1788305499.606690:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788305499.606698:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015185664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305499.606721:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305499.606762:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015185664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305499.606768:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788305499.607053:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015185664:0@lo:41:osp-pre-1-0.0 00000001:02000400:3.0:1788305500.175171:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.44 00010000:00010000:0.0:1788305500.245790:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305501.271258:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305502.297588:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305502.677714:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305502.677748:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015185792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305502.678188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.678431:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185792 00000100:00100000:2.0:1788305502.678460:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185792 00000100:00100000:2.0:1788305502.678535:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788305502.678548:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015185792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305502.678588:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305502.678672:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015185792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305502.678680:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788305502.678707:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305502.678747:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb096680 x1875174015185792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.678769:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015185792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305502.680611:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015186304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.680963:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681013:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015186816:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681043:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681063:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015187328:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681149:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788305502.681157:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015185920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305502.681185:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681203:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015186432:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681225:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681247:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015186944:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681297:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681317:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015187456:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681360:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.681398:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015186048:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.681430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305502.681920:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186304 00000100:00100000:0.0:1788305502.681932:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186304 00000100:00100000:0.0:1788305502.681991:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305502.682001:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015186304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.682090:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015186304:12345-0@lo:400:kworker.0 Request processed in 90us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305502.682099:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788305502.684043:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015185920 00000100:00100000:3.0:1788305502.684054:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015185920 00000100:00100000:3.0:1788305502.684153:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305502.684164:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015185920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305502.684203:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305502.684298:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015185920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.684306:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788305502.684560:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015186560:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.684623:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305502.684897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186048 00000100:00100000:0.0:1788305502.684903:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186048 00000100:00100000:0.0:1788305502.684936:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788305502.684943:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015186048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.684985:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015186048:12345-0@lo:400:kworker.0 Request processed in 43us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305502.684992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788305502.685079:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015187072:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.685111:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.685151:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305502.685180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.686334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015186048:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.686370:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788305502.686380:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015186176:0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.690208:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186816 00000100:00100000:0.0:1788305502.690232:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186816 00000100:00100000:0.0:1788305502.690352:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186432 00000100:00100000:0.0:1788305502.690356:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186432 00000100:00100000:0.0:1788305502.690376:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187072 00000100:00100000:0.0:1788305502.690379:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187072 00000100:00100000:0.0:1788305502.690405:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305502.690417:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015186816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.690552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015186816:12345-0@lo:400:kworker.0 Request processed in 137us (9507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305502.690561:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305502.690581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305502.690588:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015186432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.690619:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015186432:12345-0@lo:400:kworker.0 Request processed in 32us (9393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305502.690644:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305502.690657:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305502.690663:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015187072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305502.690694:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015187072:12345-0@lo:400:kworker.0 Request processed in 32us (5583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305502.690699:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788305502.690909:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.690964:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015186688:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.691009:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.691022:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015187200:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.691041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.691052:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015187712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305502.691091:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305502.691137:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015187072:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.691368:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186176 00000100:00100000:2.0:1788305502.691373:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186176 00000100:00100000:2.0:1788305502.691398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186688 00000100:00100000:2.0:1788305502.691401:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186688 00000100:00100000:2.0:1788305502.691430:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187200 00000100:00100000:2.0:1788305502.691433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187200 00000100:00100000:3.0:1788305502.691967:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788305502.691981:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015186176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305502.692045:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015186176:12345-0@lo:400:kworker.0 Request processed in 70us (5613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.692052:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788305502.692083:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305502.692090:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015186688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305502.692122:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015186688:12345-0@lo:400:kworker.0 Request processed in 33us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.692128:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305502.692140:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788305502.692146:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015187200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305502.692175:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015187200:12345-0@lo:400:kworker.0 Request processed in 30us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.692181:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788305502.692203:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187584 00000100:00100000:3.0:1788305502.692207:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187584 00000100:00100000:3.0:1788305502.692232:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187712 00000100:00100000:3.0:1788305502.692235:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187712 00000100:00100000:3.0:1788305502.692252:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305502.692269:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015187584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305502.692310:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305502.692350:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015187584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (7168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.692356:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305502.692369:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305502.692376:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015187712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305502.692387:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305502.692414:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015187712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305502.692420:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788305502.692672:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187328 00000100:00100000:2.0:1788305502.692678:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187328 00000100:00100000:2.0:1788305502.692718:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186944 00000100:00100000:2.0:1788305502.692722:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186944 00000100:00100000:2.0:1788305502.692735:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187456 00000100:00100000:2.0:1788305502.692738:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187456 00000100:00100000:2.0:1788305502.692751:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305502.692759:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015187328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.692797:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015187328:12345-0@lo:400:kworker.0 Request processed in 40us (11695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305502.692804:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305502.692816:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305502.692822:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015186944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.692850:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb760050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015186944:12345-0@lo:400:kworker.0 Request processed in 28us (11574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305502.692856:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305502.693048:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788305502.693057:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015187456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.693100:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015187456:12345-0@lo:400:kworker.0 Request processed in 45us (11740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305502.693107:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788305502.693179:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083642300 x1875174015185920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.693203:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015185920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305502.693220:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015186432:0@lo:400:kworker.0 00010000:00080000:2.0:1788305502.693247:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d3bb80 x1875174015186944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.693257:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015186944:0@lo:400:kworker.0 00010000:00080000:2.0:1788305502.693266:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb228000 x1875174015187456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.693299:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015187456:0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.693315:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015186304:0@lo:400:kworker.0 00010000:00080000:2.0:1788305502.693331:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d39180 x1875174015186816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.693339:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015186816:0@lo:400:kworker.0 00010000:00080000:2.0:1788305502.693350:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d3b800 x1875174015187328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305502.693358:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015187328:0@lo:400:kworker.0 00000100:00080000:2.0:1788305502.693401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305502.693407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305502.693410:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305502.693414:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305502.693607:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015186176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305502.693622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015186688:0@lo:400:kworker.0 00010000:00080000:3.0:1788305502.693634:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38380 x1875174015187200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305502.693644:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015187200:0@lo:400:kworker.0 00010000:00080000:3.0:1788305502.693653:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083643800 x1875174015187712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305502.693666:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015187712:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788305502.693677:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083642a00 x1875174015187584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305502.693687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015187584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305502.698500:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015186560 00000100:00100000:2.0:1788305502.698521:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015186560 00000100:00100000:2.0:1788305502.698873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305502.698885:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015186560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305502.699016:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015186560:12345-0@lo:400:kworker.0 Request processed in 133us (14392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305502.699026:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788305502.699387:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015186560:0@lo:400:kworker.0 00010000:00010000:1.0:1788305503.317682:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305503.348766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305503.348842:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305503.348878:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305503.348918:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145024 00000100:00100000:1.0:1788305503.348931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145024 00000100:00100000:1.0:1788305503.348994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00100000:1.0:1788305503.349007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2398:x1875173994145024:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305503.349113:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2398:x1875173994145024:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305503.349123:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00100000:0.0:1788305503.349712:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145152 00000100:00100000:0.0:1788305503.349719:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145152 00000100:00100000:0.0:1788305503.349782:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145280 00000100:00100000:0.0:1788305503.349786:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145280 00000100:00100000:0.0:1788305503.349813:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:0.0:1788305503.349822:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994145152:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305503.349877:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994145152:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 56us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305503.349885:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:0.0:1788305503.349901:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:0.0:1788305503.349907:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994145280:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305503.349933:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994145280:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305503.349939:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00080000:1.0:1788305503.350139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305503.350145:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1788305503.424023:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.44 00010000:00010000:0.0:1788305504.342775:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305504.726958:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015187840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305504.727032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305504.727194:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187840 00000100:00100000:0.0:1788305504.727203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187840 00000100:00100000:0.0:1788305504.727253:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305504.727263:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015187840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305504.727332:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305504.727475:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015187840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 213us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305504.727482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305504.727751:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015187968:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305504.727783:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305504.728551:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015187968 00000100:00100000:3.0:1788305504.728559:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015187968 00000100:00100000:3.0:1788305504.728598:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788305504.728607:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015187968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305504.728635:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305504.728696:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015187968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305504.728702:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305504.728853:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015187968:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305504.729118:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015187840:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788305505.366262:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788305505.990669:0:11323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.44 00010000:00010000:1.0:1788305506.389741:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305507.416458:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305507.800548:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015188096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305507.800627:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305507.800704:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188096 00000100:00100000:3.0:1788305507.800711:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188096 00000100:00100000:3.0:1788305507.800762:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305507.800773:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015188096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305507.800813:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305507.800861:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015188096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305507.800868:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788305507.800890:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305507.800921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083643800 x1875174015188096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305507.800939:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015188096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305507.801481:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015188480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305507.801525:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305507.801546:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305507.801567:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015188352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305507.801592:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305507.801617:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015188224:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305507.801639:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305507.801671:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188480 00000100:00100000:3.0:1788305507.801675:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188480 00000100:00100000:3.0:1788305507.801701:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188352 00000100:00100000:3.0:1788305507.801704:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188352 00000100:00100000:3.0:1788305507.801715:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188224 00000100:00100000:3.0:1788305507.801717:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188224 00000100:00100000:3.0:1788305507.801729:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305507.801736:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015188480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305507.801750:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305507.801793:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015188480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305507.801798:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305507.801812:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305507.801818:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015188352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305507.801833:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305507.801860:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015188352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305507.801866:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305507.801877:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305507.801884:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015188224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305507.801895:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305507.801922:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015188224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305507.801938:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1788305507.801953:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305507.801956:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305507.801974:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d16d80 x1875174015188224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305507.801989:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015188224:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788305507.802011:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083643800 x1875174015188352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305507.802033:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015188352:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788305507.802044:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083641500 x1875174015188480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305507.802054:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015188480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305507.806357:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305507.806382:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015188608:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806461:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.806548:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015188736:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806579:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.806629:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015188864:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806657:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.806705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015188992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.806772:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305507.806778:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015189120:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.806847:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188864 00000100:00100000:2.0:1788305507.806854:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188864 00000100:00100000:2.0:1788305507.806897:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189120 00000100:00100000:2.0:1788305507.806900:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189120 00000100:00100000:2.0:1788305507.806919:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305507.806928:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015188864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.806988:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015188864:12345-0@lo:400:kworker.0 Request processed in 60us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305507.806997:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305507.807044:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788305507.807051:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015189120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807089:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015189120:12345-0@lo:400:kworker.0 Request processed in 39us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305507.807095:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788305507.807131:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015188864:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807171:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015189120:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807203:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015189248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.807266:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015189376:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807311:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.807352:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015189504:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305507.807412:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305507.807418:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015189632:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.807443:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305507.807758:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188608 00000100:00100000:0.0:1788305507.807764:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188608 00000100:00100000:0.0:1788305507.807813:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788305507.807821:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015188608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.807866:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015188608:12345-0@lo:400:kworker.0 Request processed in 46us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.807872:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788305507.807900:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188736 00000100:00100000:0.0:1788305507.807903:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188736 00000100:00100000:0.0:1788305507.807920:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015188992 00000100:00100000:0.0:1788305507.807922:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015188992 00000100:00100000:0.0:1788305507.807931:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189248 00000100:00100000:0.0:1788305507.807934:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189248 00000100:00100000:0.0:1788305507.807955:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189376 00000100:00100000:0.0:1788305507.807957:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189376 00000100:00100000:0.0:1788305507.807967:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189504 00000100:00100000:0.0:1788305507.807969:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189504 00000100:00100000:0.0:1788305507.807980:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189632 00000100:00100000:0.0:1788305507.807982:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189632 00000100:00100000:0.0:1788305507.807993:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305507.807998:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015188736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808054:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015188736:12345-0@lo:400:kworker.0 Request processed in 55us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808060:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305507.808072:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788305507.808078:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015188992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808105:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015188992:12345-0@lo:400:kworker.0 Request processed in 28us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808111:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788305507.808121:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788305507.808126:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015189248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808162:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015189248:12345-0@lo:400:kworker.0 Request processed in 36us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808167:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788305507.808178:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788305507.808184:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015189376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808213:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015189376:12345-0@lo:400:kworker.0 Request processed in 30us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808219:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788305507.808229:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788305507.808235:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015189504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808257:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015189504:12345-0@lo:400:kworker.0 Request processed in 23us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808263:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788305507.808294:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788305507.808301:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015189632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808335:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015189632:12345-0@lo:400:kworker.0 Request processed in 35us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305507.808341:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:0.0:1788305507.808387:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c700 x1875174015189376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305507.808399:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015189376:0@lo:400:kworker.0 00000100:00080000:0.0:1788305507.808418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305507.808422:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788305507.808435:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053b80 x1875174015189632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305523 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305507.808444:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015189632:0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808454:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015189248:0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808463:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015188736:0@lo:400:kworker.0 00000100:00100000:0.0:1788305507.808471:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015188608:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.808859:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015189504:0@lo:400:kworker.0 00000100:00100000:2.0:1788305507.808869:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015188992:0@lo:400:kworker.0 00000001:02000400:1.0:1788305508.229968:0:11371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 1 19:31:45 EDT 2026 00010000:00010000:1.0:1788305508.446442:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305508.471068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305508.471176:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305508.471211:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305508.471301:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145664 00000100:00100000:3.0:1788305508.471306:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145536 00000100:00100000:3.0:1788305508.471311:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145536 00000100:00100000:1.0:1788305508.471312:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145664 00000100:00100000:1.0:1788305508.471438:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:1.0:1788305508.471450:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994145664:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305508.471531:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994145664:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305508.471539:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:2.0:1788305508.472009:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145408 00000100:00100000:2.0:1788305508.472026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145408 00000100:00100000:2.0:1788305508.472106:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 286 00000100:00100000:2.0:1788305508.472116:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994145408:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305508.472174:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994145408:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 60us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305508.472195:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 286 00000100:00080000:0.0:1788305508.474392:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305508.474402:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305508.475440:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:3.0:1788305508.475457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994145536:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305508.475562:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994145536:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 111us (4349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305508.475569:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00010000:00010000:3.0:1788305509.462332:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305509.846546:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015189760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305509.846624:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305509.846709:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189760 00000100:00100000:2.0:1788305509.846718:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189760 00000100:00100000:2.0:1788305509.846781:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788305509.846791:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015189760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305509.846824:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305509.846868:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015189760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305509.846875:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788305509.846923:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015189760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305509.858729:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015189888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305509.858812:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305509.858908:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015189888 00000100:00100000:1.0:1788305509.858918:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015189888 00000100:00100000:1.0:1788305509.858967:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305509.858976:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015189888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305509.859032:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305509.865926:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015189888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6941us (7104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305509.865941:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305509.872091:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015189888:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788305510.485616:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305511.509912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305512.533510:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305512.917545:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015190016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305512.917613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.917696:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190016 00000100:00100000:3.0:1788305512.917715:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190016 00000100:00100000:3.0:1788305512.917774:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305512.917784:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015190016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305512.917822:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788305512.918026:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305512.918046:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015190144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305512.918258:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015190272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305512.922724:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305512.922918:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190144 00000100:00100000:1.0:1788305512.922928:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190144 00000100:00100000:1.0:1788305512.922995:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305512.923007:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015190144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305512.923050:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305512.923098:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015190144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305512.923105:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788305512.923363:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305512.923457:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb229f80 x1875174015190144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305512.923479:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015190144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305512.923506:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015190656:0@lo:400:kworker.0 00000100:00100000:0.0:1788305512.923543:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305512.923615:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015191168:0@lo:400:kworker.0 00000100:00100000:0.0:1788305512.923638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.926131:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015190016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8340us (8509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.926144:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305512.926313:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015190400:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305512.926370:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.926411:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015190912:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.926446:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015190528:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.926475:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.926499:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015191040:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.926524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.926544:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015191552:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.926574:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191040 00000100:00100000:3.0:1788305512.926582:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191040 00000100:00100000:3.0:1788305512.926625:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788305512.926634:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015191040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.926687:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015191040:12345-0@lo:400:kworker.0 Request processed in 54us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.926693:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788305512.926718:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190400 00000100:00100000:3.0:1788305512.926721:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190400 00000100:00100000:3.0:1788305512.926753:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788305512.926759:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015190400:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305512.926788:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305512.926824:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015190400:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.926830:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788305512.926847:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305512.926908:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190528 00000100:00100000:3.0:1788305512.926912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190528 00000100:00100000:3.0:1788305512.926948:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788305512.926955:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015190528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.927005:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015190528:12345-0@lo:400:kworker.0 Request processed in 51us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.927011:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788305512.930004:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015191680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.930694:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305512.930738:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015190784:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.930785:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305512.930818:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015191296:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.930856:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305512.930944:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190784 00000100:00100000:0.0:1788305512.930951:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190784 00000100:00100000:0.0:1788305512.931008:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788305512.931030:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918346c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305512.931091:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918346c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015190784:12345-0@lo:400:kworker.0 Request processed in 64us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305512.931099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305512.933433:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190656 00000100:00100000:1.0:1788305512.933448:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190656 00000100:00100000:1.0:1788305512.933504:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191168 00000100:00100000:1.0:1788305512.933507:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191168 00000100:00100000:1.0:1788305512.933547:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788305512.933556:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015190656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305512.933644:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015190656:12345-0@lo:400:kworker.0 Request processed in 89us (10100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305512.933651:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788305512.933668:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788305512.933675:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015191168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305512.933702:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015191168:12345-0@lo:400:kworker.0 Request processed in 28us (10063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305512.933724:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1788305512.936034:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305512.936076:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190272 00000100:00100000:3.0:1788305512.936086:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190272 00000100:00100000:3.0:1788305512.936353:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788305512.936363:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015190272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305512.936387:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305512.936465:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015190272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.936472:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788305512.936953:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305512.938410:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305512.938485:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015191808:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.938546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788305512.938602:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa10000 x1875174015190272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305512.938628:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015190272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305512.938680:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015190784:0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.938710:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191808 00000100:00100000:3.0:1788305512.938715:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191808 00000100:00100000:3.0:1788305512.938780:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305512.938789:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015191808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305512.938841:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015191808:12345-0@lo:400:kworker.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305512.938862:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788305512.938891:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11880 x1875174015191808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305512.938900:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015191808:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.956594:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305512.958805:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191296 00000100:00100000:1.0:1788305512.958820:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191296 00000100:00080000:1.0:1788305512.958876:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305512.958932:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191552 00000100:00100000:1.0:1788305512.958936:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191552 00000100:00100000:1.0:1788305512.958970:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305512.958991:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015191296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305512.959101:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015191296:12345-0@lo:400:kworker.0 Request processed in 112us (28253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305512.959108:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305512.959126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788305512.959133:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015191552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305512.959174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015191552:12345-0@lo:400:kworker.0 Request processed in 42us (20769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305512.959180:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788305512.959200:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788305512.959233:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa10e00 x1875174015191296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305512.959247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015191296:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968399:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015191424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968462:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305512.968482:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015191936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968502:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788305512.968560:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053480 x1875174015190400/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305512.968584:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015190400:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305512.968623:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191424 00000100:00100000:2.0:1788305512.968628:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191424 00000100:00100000:2.0:1788305512.968670:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191936 00000100:00100000:2.0:1788305512.968673:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191936 00000100:00100000:2.0:1788305512.968693:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305512.968702:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015191424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968748:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015191424:12345-0@lo:400:kworker.0 Request processed in 48us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305512.968755:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305512.968770:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305512.968775:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015191936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968801:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015191936:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305512.968807:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788305512.968837:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa10a80 x1875174015191424/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305512.968859:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015191424:0@lo:400:kworker.0 00010000:00080000:2.0:1788305512.968870:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11f80 x1875174015191936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305512.968877:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015191936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305512.968936:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015190656:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968958:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015191168:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.968993:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015190912 00000100:00100000:2.0:1788305512.968997:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015190912 00000100:00100000:2.0:1788305512.969020:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015191680 00000100:00100000:2.0:1788305512.969023:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015191680 00000100:00100000:2.0:1788305512.969044:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788305512.969050:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015190912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.969085:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015190912:12345-0@lo:400:kworker.0 Request processed in 36us (12500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305512.969091:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788305512.969103:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788305512.969109:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015191680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.969302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015191680:12345-0@lo:400:kworker.0 Request processed in 30us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305512.969310:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:2.0:1788305512.969327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305512.969346:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015190912:0@lo:400:kworker.0 00010000:00080000:2.0:1788305512.969367:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa13480 x1875174015191680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305512.969376:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015191680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.969419:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015191552:0@lo:400:kworker.0 00010000:00080000:2.0:1788305512.969431:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083643800 x1875174015190016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305512.969444:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015190016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305512.969474:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015190528:0@lo:400:kworker.0 00000100:00100000:2.0:1788305512.969485:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015191040:0@lo:400:kworker.0 00010000:00010000:1.0:1788305513.559675:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305513.583524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305513.583565:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305513.583599:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305513.583628:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145792 00000100:00100000:1.0:1788305513.583645:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145792 00000100:00100000:1.0:1788305513.583697:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 288 00000100:00100000:1.0:1788305513.583707:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994145792:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305513.583773:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994145792:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 68us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305513.583782:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 288 00000100:00100000:1.0:1788305513.583813:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994145920 00000100:00100000:1.0:1788305513.583817:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994145920 00000100:00100000:1.0:1788305513.583851:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146048 00000100:00100000:1.0:1788305513.583854:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146048 00000100:00100000:1.0:1788305513.583875:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788305513.583882:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994145920:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305513.583911:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994145920:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305513.583917:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:1.0:1788305513.583929:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:1.0:1788305513.583935:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994146048:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305513.583957:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994146048:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305513.583962:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00080000:1.0:1788305513.584097:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305513.584101:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305514.586192:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305514.965628:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015192064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305514.965743:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305514.968035:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305514.968059:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015192192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305514.968123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305514.975366:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192064 00000100:00100000:1.0:1788305514.975382:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192064 00000100:00100000:3.0:1788305514.975457:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192192 00000100:00100000:3.0:1788305514.975462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192192 00000100:00100000:1.0:1788305514.975465:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305514.975475:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015192064:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305514.975498:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788305514.975504:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015192192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305514.975530:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000004:00000024:1.0:1788305514.975530:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305514.976141:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015192192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 634us (8014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305514.976149:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788305514.976198:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015192192:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305514.979757:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015192064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4271us (14002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305514.979773:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788305514.981986:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015192064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788305515.605402:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305516.632074:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305517.654623:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305518.037535:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015192704:0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.037606:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.037667:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015193216:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.037896:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015192320:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.037961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.037980:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.038001:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015193728:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015192832:0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038024:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038039:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038055:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015193344:0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038073:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015192448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038094:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015193856:0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038095:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.038110:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015192960:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038112:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.038128:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.038143:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015193472:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038178:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192320 00000100:00100000:0.0:1788305518.038186:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192320 00000100:00100000:0.0:1788305518.038233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788305518.038237:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015192320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038256:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015193984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305518.038305:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038305:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015192320:12345-0@lo:400:kworker.0 Request processed in 63us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.038313:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788305518.038323:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788305518.038329:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015192576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038344:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192832 00000100:00100000:0.0:1788305518.038347:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192832 00000100:00100000:1.0:1788305518.038349:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305518.038364:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015193088:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038368:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192576 00000100:00100000:0.0:1788305518.038370:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192576 00000100:00100000:1.0:1788305518.038383:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038383:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788305518.038389:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015192832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038403:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015193600:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038419:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015192832:12345-0@lo:400:kworker.0 Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.038421:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.038426:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788305518.038438:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305518.038439:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192704 00000100:00100000:1.0:1788305518.038442:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192704 00000100:00100000:0.0:1788305518.038443:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015192576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038460:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192448 00000100:00100000:1.0:1788305518.038463:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192448 00000100:00100000:0.0:1788305518.038472:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015192576:12345-0@lo:400:kworker.0 Request processed in 30us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.038474:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015192960 00000100:00100000:1.0:1788305518.038476:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015192960 00000100:00100000:0.0:1788305518.038486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305518.038493:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193472 00000100:00100000:1.0:1788305518.038496:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193472 00000100:00100000:0.0:1788305518.038502:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193216 00000100:00100000:0.0:1788305518.038505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193216 00000100:00100000:1.0:1788305518.038507:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193088 00000100:00100000:1.0:1788305518.038509:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193088 00000100:00100000:1.0:1788305518.038517:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193600 00000100:00100000:1.0:1788305518.038519:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193600 00000100:00100000:0.0:1788305518.038520:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193728 00000100:00100000:0.0:1788305518.038521:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193728 00000100:00100000:1.0:1788305518.038530:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788305518.038530:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193344 00000100:00100000:0.0:1788305518.038532:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193344 00000100:00100000:1.0:1788305518.038535:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015192704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038541:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193856 00000100:00100000:0.0:1788305518.038544:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193856 00000100:00100000:0.0:1788305518.038555:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305518.038561:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015193216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038565:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015192704:12345-0@lo:400:kworker.0 Request processed in 31us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.038571:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788305518.038583:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788305518.038588:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015192448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038588:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015193216:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.038594:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305518.038604:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305518.038609:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015193728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.038610:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015192448:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.038615:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788305518.038625:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788305518.038630:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015192960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038631:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015193728:12345-0@lo:400:kworker.0 Request processed in 23us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.038637:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305518.038647:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788305518.038652:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015193344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038678:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015193344:12345-0@lo:400:kworker.0 Request processed in 26us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.038683:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788305518.038693:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305518.038699:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015193856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038736:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015193856:12345-0@lo:400:kworker.0 Request processed in 38us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.038742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788305518.038850:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015192320:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038865:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015192832:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.038876:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa13b80 x1875174015193344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.038886:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015193344:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.038894:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355f80 x1875174015193856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.038901:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015193856:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788305518.038967:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015193472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.038997:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015193472:12345-0@lo:400:kworker.0 Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.039003:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788305518.039015:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788305518.039020:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.039022:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015192960:12345-0@lo:400:kworker.0 Request processed in 391us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.039036:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788305518.039043:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015193088:12345-0@lo:400:kworker.0 Request processed in 23us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.039048:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788305518.039053:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015193600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305518.039080:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015193600:12345-0@lo:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305518.039180:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015194112:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305518.039211:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.039391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788305518.039443:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015193984 00000100:00100000:0.0:1788305518.039448:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015193984 00000100:00100000:0.0:1788305518.039478:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194112 00000100:00100000:0.0:1788305518.039482:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194112 00000100:00100000:0.0:1788305518.039492:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305518.039498:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015193984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305518.039521:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305518.039551:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015193984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.039557:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305518.039568:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788305518.039574:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015194112:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305518.039583:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305518.039610:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015194112:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.039616:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788305518.039640:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485880 x1875174015194112/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039654:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015194112:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788305518.039683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305518.039688:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305518.039690:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305518.039692:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305518.039707:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015192576:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.039717:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa10a80 x1875174015193088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039724:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015193088:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.039733:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa13100 x1875174015193600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039748:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015193600:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.039759:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d45c00 x1875174015193984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039782:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015193984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305518.039793:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015192448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.039802:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015192960:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.039811:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015193472:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.039849:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015192704:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.039860:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11880 x1875174015193216/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039867:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015193216:0@lo:400:kworker.0 00010000:00080000:0.0:1788305518.039889:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354380 x1875174015193728/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.039897:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015193728:0@lo:400:kworker.0 00000100:00100000:0.0:1788305518.039953:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305518.039960:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015194240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305518.039985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.040009:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194240 00000100:00100000:0.0:1788305518.040012:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194240 00000100:00100000:0.0:1788305518.040028:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788305518.040033:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015194240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305518.040053:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305518.040085:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015194240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.040090:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788305518.040114:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d45c00 x1875174015194240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305518.040127:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015194240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305518.041390:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788305518.045409:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305518.045434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015194368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305518.045507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305518.045557:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194368 00000100:00100000:0.0:1788305518.045565:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194368 00000100:00100000:0.0:1788305518.045618:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788305518.045628:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015194368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305518.045650:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305518.045692:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015194368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.045700:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788305518.045731:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d45c00 x1875174015194368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305534 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305518.045751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015194368:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788305518.677778:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305518.701820:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305518.702193:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146176 00000100:00100000:1.0:1788305518.702202:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146176 00000100:00100000:1.0:1788305518.702262:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 290 00000100:00100000:1.0:1788305518.702301:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994146176:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305518.702386:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994146176:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 115us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305518.702394:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 290 00000100:00100000:1.0:1788305518.706265:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305518.706344:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146304 00000100:00100000:2.0:1788305518.706354:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146304 00000100:00080000:1.0:1788305518.706418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305518.706440:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:2.0:1788305518.706451:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994146304:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305518.706538:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994146304:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 89us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305518.706547:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:2.0:1788305518.708539:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305518.708610:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146432 00000100:00100000:0.0:1788305518.708619:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146432 00000100:00100000:0.0:1788305518.708684:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:0.0:1788305518.708694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994146432:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305518.708767:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994146432:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 74us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305518.708775:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00080000:1.0:1788305518.708905:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788305519.701493:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305520.089454:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305520.089477:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015194496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305520.089554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305520.089621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194496 00000100:00100000:3.0:1788305520.089637:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194496 00000100:00100000:3.0:1788305520.089686:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788305520.089695:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015194496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305520.089729:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305520.089798:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015194496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305520.089806:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788305520.089849:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015194496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305520.098381:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305520.098403:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015194624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305520.098477:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305520.098538:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194624 00000100:00100000:0.0:1788305520.098545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194624 00000100:00100000:0.0:1788305520.098589:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305520.098600:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015194624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305520.098635:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305520.098717:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015194624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305520.098725:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305520.098772:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015194624:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788305520.729951:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305521.749468:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305522.774011:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305523.157656:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015194752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305523.157721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305523.157846:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194752 00000100:00100000:0.0:1788305523.157855:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194752 00000100:00100000:0.0:1788305523.157939:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305523.157951:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015194752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305523.157982:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305523.158009:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015194880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305523.158045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305523.158108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305523.158119:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015194880 00000100:00100000:1.0:1788305523.158123:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015194880 00000100:00100000:1.0:1788305523.158148:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305523.158156:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015194880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305523.158172:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305523.158209:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015194880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305523.158216:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788305523.158236:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788305523.158260:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485880 x1875174015194880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305523.158292:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015194880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305523.158714:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015195136:0@lo:400:kworker.0 00000100:00100000:2.0:1788305523.158757:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305523.162564:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305523.162580:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015195008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305523.162636:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305523.162672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195136 00000100:00100000:2.0:1788305523.162678:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195136 00000100:00100000:2.0:1788305523.162717:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788305523.162742:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015195136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305523.162821:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015195136:12345-0@lo:400:kworker.0 Request processed in 79us (4062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305523.163221:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788305523.163264:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195008 00000100:00100000:2.0:1788305523.163268:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195008 00000100:00100000:2.0:1788305523.163311:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305523.163316:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015195008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305523.163329:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305523.163354:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015195008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305523.163358:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1788305523.163383:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb3ab100 x1875174015195008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305523.163398:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015195008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305523.163405:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015195136:0@lo:400:kworker.0 00000100:00080000:2.0:1788305523.163477:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305523.163496:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015195392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305523.163515:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305523.163528:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305523.163532:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015195264:0@lo:400:kworker.0 00000100:00100000:2.0:1788305523.163547:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305523.163570:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195392 00000100:00100000:2.0:1788305523.163572:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195392 00000100:00100000:2.0:1788305523.163587:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788305523.163591:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015195392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305523.163606:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305523.163629:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015195392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305523.163633:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1788305523.163643:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305523.163652:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485880 x1875174015195392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305523.163661:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015195392:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305523.163677:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195264 00000100:00100000:2.0:1788305523.163679:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195264 00000100:00100000:2.0:1788305523.163698:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305523.163702:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015195264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305523.163732:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015195264:12345-0@lo:400:kworker.0 Request processed in 29us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305523.163737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305523.163762:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015195264:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.164214:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015194752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6264us (6490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.164223:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788305523.165566:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d45180 x1875174015194752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305523.165583:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015194752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305523.172192:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015195520:0@lo:400:kworker.0 00000100:00100000:2.0:1788305523.172271:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305523.172446:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195520 00000100:00100000:3.0:1788305523.172454:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195520 00000100:00100000:3.0:1788305523.172502:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788305523.172512:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015195520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.172718:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015195648:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.172753:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305523.172800:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195648 00000100:00100000:0.0:1788305523.172815:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195648 00000100:00100000:0.0:1788305523.172843:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788305523.172850:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015195648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.172911:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015195648:12345-0@lo:400:kworker.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.172926:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788305523.172973:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015195648:0@lo:400:kworker.0 00000100:00100000:3.0:1788305523.177231:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015195520:12345-0@lo:400:kworker.0 Request processed in 4704us (4943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305523.177247:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788305523.177379:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015195520:0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.179549:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015196160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.179643:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305523.179683:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305523.179690:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015196032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.179713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305523.179743:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196160 00000100:00100000:1.0:1788305523.179750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196160 00000100:00100000:1.0:1788305523.179809:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196032 00000100:00100000:1.0:1788305523.179812:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196032 00000100:00100000:1.0:1788305523.179833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788305523.179843:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015196160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.179902:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015196160:12345-0@lo:400:kworker.0 Request processed in 61us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305523.179909:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788305523.179943:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788305523.179949:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015196032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.179978:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015196032:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305523.179984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1788305523.180002:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305523.180006:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788305523.180034:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb097100 x1875174015196032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305523.180047:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015196032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.180072:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015196160:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.180177:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015195904:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.180208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305523.180234:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305523.180240:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015195776:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.180263:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305523.180308:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015196288:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.180329:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305523.180356:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195776 00000100:00100000:0.0:1788305523.180359:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195776 00000100:00100000:0.0:1788305523.180386:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305523.180392:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015195776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.180431:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015195776:12345-0@lo:400:kworker.0 Request processed in 39us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.180437:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305523.180464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015195776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305523.181215:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015195904 00000100:00100000:1.0:1788305523.181221:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015195904 00000100:00100000:1.0:1788305523.181263:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196288 00000100:00100000:1.0:1788305523.181266:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196288 00000100:00100000:1.0:1788305523.181303:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788305523.181311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015195904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788305523.181368:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305523.181372:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305523.181393:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788305523.181401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015196288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.181441:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015196288:12345-0@lo:400:kworker.0 Request processed in 41us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.181459:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:0.0:1788305523.181489:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb097b80 x1875174015196288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305523.181500:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015196288:0@lo:400:kworker.0 00000100:00100000:0.0:1788305523.185555:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015195904:12345-0@lo:400:kworker.0 Request processed in 4234us (5334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.185572:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788305523.190525:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015195904:0@lo:400:kworker.0 00010000:00010000:1.0:1788305523.799915:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305523.832544:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305523.832650:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305523.832685:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305523.832725:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146560 00000100:00100000:3.0:1788305523.832736:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146560 00000100:00100000:3.0:1788305523.832808:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:3.0:1788305523.832819:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2398:x1875173994146560:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305523.832906:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2398:x1875173994146560:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 88us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305523.832928:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:0.0:1788305523.852341:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146688 00000100:00100000:0.0:1788305523.852357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146688 00000100:00100000:0.0:1788305523.852430:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146816 00000100:00100000:0.0:1788305523.852434:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146816 00000100:00100000:0.0:1788305523.852463:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:0.0:1788305523.852474:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994146688:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305523.852558:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994146688:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 86us (20028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.852566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:0.0:1788305523.852583:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:0.0:1788305523.852589:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994146816:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305523.852618:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994146816:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (19932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305523.852624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00080000:0.0:1788305523.852655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305523.852659:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788305524.594225:0:12001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:32:02 (1788305522) === 00010000:00010000:0.0:1788305524.823757:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305525.205557:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305525.205582:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305525.205673:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305525.205904:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196416 00000100:00100000:3.0:1788305525.205912:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196416 00000100:00100000:3.0:1788305525.205962:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788305525.205973:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305525.206007:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305525.206067:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.206074:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788305525.206472:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305525.206906:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015196544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305525.206960:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305525.207077:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196544 00000100:00100000:0.0:1788305525.207087:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196544 00000100:00100000:0.0:1788305525.207128:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788305525.207136:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015196544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305525.207169:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305525.207222:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015196544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.207229:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788305525.207428:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015196544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305525.209608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.209815:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994146944 00000100:00100000:2.0:1788305525.209823:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994146944 00000100:00100000:2.0:1788305525.209923:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 293 00000100:00100000:2.0:1788305525.209934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:8726:x1875173994146944:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788305525.209948:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305525.209966:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eaa00/0x4a426866e60535bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe082dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305525.210005:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eaa00/0x4a426866e60535bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082dc expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305525.210016:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eaa00/0x4a426866e60535bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082dc expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305525.210026:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eaa00, rc 0) 00000100:00100000:2.0:1788305525.210092:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994146944:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 160us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305525.210100:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 293 00000100:00100000:0.0:1788305525.233014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.234015:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147072 00000100:00100000:3.0:1788305525.234026:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147072 00000100:00100000:3.0:1788305525.234086:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 294 00000100:00100000:3.0:1788305525.234096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994147072:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305525.234353:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994147072:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 257us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.234362:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 294 00000100:00100000:0.0:1788305525.245506:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.245779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147200 00000100:00100000:2.0:1788305525.245789:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147200 00000100:00100000:2.0:1788305525.245851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 295 00000100:00100000:2.0:1788305525.245870:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994147200:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788305525.246114:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994147200:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 252us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305525.246133:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 295 00000100:00100000:0.0:1788305525.251168:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.251531:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147328 00000100:00100000:3.0:1788305525.251542:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147328 00000100:00100000:3.0:1788305525.251605:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 296 00000100:00100000:3.0:1788305525.251616:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147328:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305525.251783:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147328:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 168us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.251791:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 296 00000100:00100000:0.0:1788305525.276385:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.276457:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147456 00000100:00100000:3.0:1788305525.276465:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147456 00000100:00100000:3.0:1788305525.276516:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 297 00000100:00100000:3.0:1788305525.276528:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147456:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305525.276706:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147456:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 180us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.276715:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 297 00000100:00100000:0.0:1788305525.287181:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.287333:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147584 00000100:00100000:2.0:1788305525.287347:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147584 00000100:00100000:2.0:1788305525.287429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 298 00000100:00100000:2.0:1788305525.287440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147584:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305525.287608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8730:x1875173994147584:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 168us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305525.287617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 298 00000100:00100000:1.0:1788305525.305660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.309259:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147712 00000100:00100000:0.0:1788305525.309295:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147712 00000100:00100000:0.0:1788305525.309361:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 299 00000100:00100000:0.0:1788305525.309369:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:8726:x1875173994147712:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305525.309391:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305525.309409:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a000/0x4a426866e60535c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0830d expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305525.309436:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a000/0x4a426866e60535c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0830d expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305525.309444:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a000/0x4a426866e60535c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0830d expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305525.309452:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a000, rc 0) 00000100:00100000:0.0:1788305525.309512:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:8726:x1875173994147712:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 144us (3875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.309530:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 299 00000100:00100000:0.0:1788305525.317326:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.318332:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147840 00000100:00100000:2.0:1788305525.318347:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147840 00000100:00100000:2.0:1788305525.318417:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 300 00000100:00100000:2.0:1788305525.318428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:8726:x1875173994147840:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788305525.318455:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788305525.318479:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788305525.318484:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788305525.318487:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788305525.318490:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788305525.318493:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1788305525.323155:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:8726:x1875173994147840:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 4710us (5863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.323171:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 300 00000100:00100000:1.0:1788305525.330489:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.330780:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994147968 00000100:00100000:3.0:1788305525.330791:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994147968 00000100:00100000:3.0:1788305525.330929:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 301 00000100:00100000:3.0:1788305525.330941:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:8726:x1875173994147968:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305525.330958:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305525.330978:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08314 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305525.331009:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305525.331022:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305525.331033:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305525.331102:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8726:x1875173994147968:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 163us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.331109:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 301 00000100:00100000:0.0:1788305525.342403:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.342591:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148096 00000100:00100000:1.0:1788305525.342602:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148096 00000100:00100000:1.0:1788305525.342670:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:1.0:1788305525.342682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8726:x1875173994148096:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305525.342850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8726:x1875173994148096:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 169us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.342858:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:2.0:1788305525.345475:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.346099:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148224 00000100:00100000:3.0:1788305525.346111:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148224 00000100:00100000:3.0:1788305525.346201:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 303 00000100:00100000:3.0:1788305525.346210:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8726:x1875173994148224:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788305525.346568:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8726:x1875173994148224:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 357us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.346577:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 303 00000100:00100000:3.0:1788305525.354820:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.355066:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148352 00000100:00100000:0.0:1788305525.355076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148352 00000100:00100000:0.0:1788305525.355237:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00100000:0.0:1788305525.355249:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8735:x1875173994148352:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305525.355467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8735:x1875173994148352:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 220us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.355476:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00100000:3.0:1788305525.358124:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.358366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148480 00000100:00100000:1.0:1788305525.358376:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148480 00000100:00100000:1.0:1788305525.358436:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 305 00000100:00100000:1.0:1788305525.358447:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8735:x1875173994148480:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305525.358584:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:8735:x1875173994148480:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 138us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.358592:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 305 00000100:00100000:2.0:1788305525.364700:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.364734:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.364776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149248 00000100:00100000:0.0:1788305525.364789:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149248 00000100:00100000:1.0:1788305525.364920:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149376 00000100:00100000:1.0:1788305525.364925:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149376 00000100:00100000:0.0:1788305525.364927:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:0.0:1788305525.364937:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994149248:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305525.365029:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2398:x1875173994149248:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 94us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.365037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00080000:2.0:1788305525.365666:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305525.365672:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305525.365977:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:1.0:1788305525.365988:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994149376:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305525.366046:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994149376:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 60us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.366053:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:2.0:1788305525.373470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305525.373570:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.373868:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148608 00000100:00100000:0.0:1788305525.373881:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148608 00000100:00100000:3.0:1788305525.374047:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148864 00000100:00100000:3.0:1788305525.374052:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148864 00000100:00100000:3.0:1788305525.374088:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788305525.374097:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875173994148608:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788305525.374126:0:6521:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c1c667bf-adbd-4039-9541-664be6dfc9fd@192.168.202.55@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1788305525.374180:0:6521:0:(genops.c:1385:class_connect()) connect: client c1c667bf-adbd-4039-9541-664be6dfc9fd, cookie 0x4a426866e60535d0 00000004:00100000:3.0:1788305525.374210:0:6521:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788305525.374488:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788305525.374495:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2394:x1875173994148864:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788305525.374512:0:10615:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from c1c667bf-adbd-4039-9541-664be6dfc9fd@192.168.202.55@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:1.0:1788305525.374548:0:10615:0:(genops.c:1385:class_connect()) connect: client c1c667bf-adbd-4039-9541-664be6dfc9fd, cookie 0x4a426866e60535d7 00000004:00100000:1.0:1788305525.374562:0:10615:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788305525.374724:0:10615:0:(import.c:65:import_set_state_nolock()) ffff8891bf9af000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305525.374849:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2394:x1875173994148864:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 351us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.374856:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00080000:3.0:1788305525.375083:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8890825d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305525.375112:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2394:x1875173994148608:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 1015us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.375118:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:3.0:1788305525.378048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.378139:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.378620:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148992 00000100:00100000:1.0:1788305525.378633:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148992 00000100:00080000:2.0:1788305525.378804:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305525.378876:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.378988:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994148736 00000100:00100000:1.0:1788305525.378992:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994148736 00000100:00100000:1.0:1788305525.379030:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149120 00000100:00100000:1.0:1788305525.379033:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149120 00000100:00100000:1.0:1788305525.379047:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788305525.379056:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:0:x1875173994148992:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305525.379086:0:10615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305525.379234:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:0:x1875173994148992:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 178us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.379242:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788305525.379260:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788305525.379267:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+7:0:x1875173994148736:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305525.379303:0:10615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305525.379342:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+7:0:x1875173994148736:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 75us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.379348:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788305525.379362:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:1.0:1788305525.379369:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149120:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788305525.379401:0:10615:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305525.379426:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149120:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 57us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.379433:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00080000:2.0:1788305525.380784:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305525.381790:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.381908:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149504 00000100:00100000:1.0:1788305525.381918:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149504 00000100:00100000:1.0:1788305525.382000:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305525.382012:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149504:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788305525.382095:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149504:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305525.382102:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305525.384061:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305525.384101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305525.384186:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149888 00000100:00100000:3.0:1788305525.384194:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149888 00000100:00100000:3.0:1788305525.384235:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:3.0:1788305525.384242:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149888:12345-192.168.202.55@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788305525.384310:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994149888:12345-192.168.202.55@tcp:900:mount.lustre.0 Request processed in 69us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.384328:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305525.384546:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.389443:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149632 00000100:00100000:0.0:1788305525.389459:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149632 00000100:00100000:0.0:1788305525.389534:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994149760 00000100:00100000:0.0:1788305525.389538:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994149760 00000100:00100000:0.0:1788305525.389573:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305525.389582:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875173994149632:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788305525.389617:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c1c667bf-adbd-4039-9541-664be6dfc9fd@192.168.202.55@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:0.0:1788305525.389673:0:8435:0:(genops.c:1385:class_connect()) connect: client c1c667bf-adbd-4039-9541-664be6dfc9fd, cookie 0x4a426866e60535de 00002000:00100000:0.0:1788305525.389686:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c1c667bf-adbd-4039-9541-664be6dfc9fd/ffff8891bf99e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305525.389705:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305525.389793:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788305525.389826:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8891bf99d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305525.389899:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305525.389906:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994149760:12345-192.168.202.55@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788305525.389911:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2394:x1875173994149632:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 329us (5809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.389918:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00010000:00080000:3.0:1788305525.389924:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c1c667bf-adbd-4039-9541-664be6dfc9fd@192.168.202.55@tcp t0 exp 0000000000000000 cur 355 last 0 00000020:00000080:3.0:1788305525.389947:0:8436:0:(genops.c:1385:class_connect()) connect: client c1c667bf-adbd-4039-9541-664be6dfc9fd, cookie 0x4a426866e60535e5 00002000:00100000:3.0:1788305525.389953:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c1c667bf-adbd-4039-9541-664be6dfc9fd/ffff8890825d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788305525.389963:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788305525.390003:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788305525.390019:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8890825d3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305525.390043:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2394:x1875173994149760:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 136us (5497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305525.390050:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305525.392742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305525.392822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150016 00000100:00100000:0.0:1788305525.392831:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150016 00000100:00100000:0.0:1788305525.392953:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:0.0:1788305525.392965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994150016:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788305525.393050:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788305525.393139:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:8726:x1875173994150016:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 176us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305525.393146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00010000:00010000:1.0:1788305525.847676:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305526.869696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305527.894522:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305528.279513:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305528.279547:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015196672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305528.279669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.279790:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196672 00000100:00100000:2.0:1788305528.279798:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196672 00000100:00100000:2.0:1788305528.279879:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788305528.279893:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015196672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305528.279932:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305528.280383:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015196672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 492us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.280394:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788305528.280430:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305528.280464:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.280499:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305528.280505:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305528.280540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305528.280571:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305528.280586:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196800 00000100:00100000:2.0:1788305528.280591:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196800 00000100:00100000:2.0:1788305528.280709:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015196928 00000100:00100000:2.0:1788305528.280713:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015196928 00000100:00100000:2.0:1788305528.280730:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305528.280737:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305528.280760:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305528.280802:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.280808:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305528.280851:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305528.280859:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305528.280869:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305528.280897:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c052c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015196928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.280902:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788305528.281209:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083640380 x1875174015196672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305528.281234:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015196672:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788305528.281909:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305528.281916:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788305528.281946:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083641500 x1875174015196928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305528.282491:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083641500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196928:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788305528.282517:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8e00000 x1875174015196800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305528.282532:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015196800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305528.283066:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305528.283084:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015197056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305528.283162:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305528.283340:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197056 00000100:00100000:0.0:1788305528.283350:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197056 00000100:00100000:0.0:1788305528.283426:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788305528.283437:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015197056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305528.283465:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305528.283525:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015197056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305528.283533:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788305528.283571:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8e00000 x1875174015197056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305528.283606:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015197056:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788305528.283813:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305528.285002:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015197184:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285095:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305528.285150:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015197696:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305528.285199:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015198208:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305528.285308:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305528.285315:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015197568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285340:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305528.285359:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015198080:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285385:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305528.285418:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198208 00000100:00100000:1.0:1788305528.285427:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198208 00000100:00100000:1.0:1788305528.285483:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197568 00000100:00100000:1.0:1788305528.285486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197568 00000100:00100000:1.0:1788305528.285500:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198080 00000100:00100000:1.0:1788305528.285502:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198080 00000100:00100000:1.0:1788305528.285521:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788305528.285530:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015198208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015198208:12345-0@lo:400:kworker.0 Request processed in 62us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305528.285614:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788305528.285643:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788305528.285650:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015197568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285679:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015197568:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305528.285685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788305528.285696:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788305528.285703:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015198080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285726:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015198080:12345-0@lo:400:kworker.0 Request processed in 24us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305528.285744:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1788305528.285773:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305528.285777:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305528.285810:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015197568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.285822:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015198080:0@lo:400:kworker.0 00010000:00080000:1.0:1788305528.285848:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa13100 x1875174015198208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305528.285859:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015198208:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287094:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015197440:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287180:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.287224:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015197952:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.287301:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788305528.287310:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015197312:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287337:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.287356:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015197824:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287379:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305528.287416:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197952 00000100:00100000:2.0:1788305528.287424:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197952 00000100:00100000:2.0:1788305528.287502:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197312 00000100:00100000:2.0:1788305528.287506:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197312 00000100:00100000:2.0:1788305528.287518:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197824 00000100:00100000:2.0:1788305528.287521:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197824 00000100:00100000:2.0:1788305528.287537:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788305528.287546:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015197952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.287623:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015197952:12345-0@lo:400:kworker.0 Request processed in 77us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.287916:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788305528.287936:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788305528.287943:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015197312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.288074:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015197312:12345-0@lo:400:kworker.0 Request processed in 131us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.288081:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788305528.288093:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788305528.288100:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015197824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.288128:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015197824:12345-0@lo:400:kworker.0 Request processed in 29us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305528.288134:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788305528.288165:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305528.288171:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305528.288217:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015197312:0@lo:400:kworker.0 00000100:00100000:2.0:1788305528.288229:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015197824:0@lo:400:kworker.0 00010000:00080000:2.0:1788305528.288242:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11f80 x1875174015197952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305528.288254:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015197952:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.288411:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197696 00000100:00100000:1.0:1788305528.288417:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197696 00000100:00100000:1.0:1788305528.288464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197440 00000100:00100000:1.0:1788305528.288467:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197440 00000100:00100000:1.0:1788305528.288483:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305528.288490:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015197696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.288537:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015197696:12345-0@lo:400:kworker.0 Request processed in 48us (3354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305528.288544:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305528.288559:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305528.288566:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015197440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.288611:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015197440:12345-0@lo:400:kworker.0 Request processed in 46us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305528.288617:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305528.288770:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015197440:0@lo:400:kworker.0 00000100:00100000:1.0:1788305528.288803:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015197696:0@lo:400:kworker.0 00000100:00100000:0.0:1788305528.289039:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015197184 00000100:00100000:0.0:1788305528.289047:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015197184 00000100:00100000:0.0:1788305528.289093:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788305528.289102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015197184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305528.289151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015197184:12345-0@lo:400:kworker.0 Request processed in 51us (4056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305528.289157:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788305528.289336:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015197184:0@lo:400:kworker.0 00010000:00010000:1.0:1788305528.918631:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305529.943653:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305530.326390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015198336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305530.326509:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305530.326768:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198336 00000100:00100000:1.0:1788305530.326779:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198336 00000100:00100000:1.0:1788305530.326888:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788305530.326902:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015198336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305530.326953:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305530.327009:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015198336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305530.327017:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788305530.327214:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015198336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305530.327238:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305530.327246:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015198464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305530.327298:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305530.328163:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198464 00000100:00100000:1.0:1788305530.328171:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198464 00000100:00100000:1.0:1788305530.328228:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305530.328238:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015198464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305530.328269:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305530.328357:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015198464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305530.328364:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788305530.328665:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015198464:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305530.481249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481339:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481470:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305530.481503:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150912 00000100:00100000:0.0:1788305530.481514:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150912 00000100:00100000:0.0:1788305530.481755:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150784 00000100:00100000:0.0:1788305530.481759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150784 00000100:00100000:0.0:1788305530.481790:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305530.481801:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150912:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305530.481904:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150912:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 104us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305530.481912:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305530.481931:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788305530.481957:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150784:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305530.481986:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150784:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305530.481992:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:3.0:1788305530.482080:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150400 00000100:00100000:3.0:1788305530.482085:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150400 00000100:00100000:3.0:1788305530.482113:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150656 00000100:00100000:3.0:1788305530.482115:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150656 00000100:00100000:3.0:1788305530.482129:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150272 00000100:00100000:3.0:1788305530.482131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150272 00000100:00100000:3.0:1788305530.482144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150528 00000100:00100000:3.0:1788305530.482158:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150528 00000100:00100000:3.0:1788305530.482177:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:3.0:1788305530.482193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994150400:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305530.482226:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994150400:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305530.482233:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:3.0:1788305530.482246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:3.0:1788305530.482252:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150656:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305530.482321:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150656:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305530.482328:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:3.0:1788305530.482340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:3.0:1788305530.482347:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994150272:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305530.482371:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994150272:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305530.482377:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:3.0:1788305530.482390:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:3.0:1788305530.482396:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150528:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305530.482419:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2396:x1875173994150528:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305530.482425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:2.0:1788305530.485576:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994150144 00000100:00100000:2.0:1788305530.485600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994150144 00000100:00100000:2.0:1788305530.485699:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 307 00000100:00100000:2.0:1788305530.485715:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994150144:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:0.0:1788305530.485774:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305530.485783:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305530.485788:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305530.485792:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305530.485858:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994150144:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 148us (4623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305530.485868:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 307 00000001:00100000:0.0:1788305530.841442:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:2.0:1788305530.842783:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:2.0:1788305530.843116:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:1.0:1788305530.848163:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00010000:00010000:0.0:1788305530.965624:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305531.992791:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305532.083829:0:12194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788305533.013648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305533.397424:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015198592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305533.397508:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305533.398203:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015198848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305533.398239:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.398379:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015198720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305533.398409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.398448:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198592 00000100:00100000:2.0:1788305533.398456:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198592 00000100:00100000:2.0:1788305533.398514:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198848 00000100:00100000:2.0:1788305533.398518:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198848 00000100:00100000:2.0:1788305533.398547:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198720 00000100:00100000:2.0:1788305533.398719:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198720 00000100:00100000:2.0:1788305533.398744:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305533.398754:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015198592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305533.398783:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305533.398838:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015198592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305533.398846:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305533.398864:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305533.398871:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015198848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305533.398883:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305533.398993:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305533.399003:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015198720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305533.399020:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305533.399057:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015198720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305533.399063:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305533.401664:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015198848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2784us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305533.401680:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788305533.401711:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305533.401717:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305533.401898:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015198976:0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.401958:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.402003:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015198976 00000100:00100000:2.0:1788305533.402009:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015198976 00000100:00100000:2.0:1788305533.402047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788305533.402055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015198976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.402100:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015198976:12345-0@lo:400:kworker.0 Request processed in 45us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305533.402106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:2.0:1788305533.402155:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083642a00 x1875174015198720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305533.402190:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015198720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305533.402208:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305533.402214:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015199104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305533.402244:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.402648:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199104 00000100:00100000:2.0:1788305533.402654:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199104 00000100:00100000:2.0:1788305533.402690:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788305533.402697:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015199104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305533.402710:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305533.402747:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015199104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305533.402754:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788305533.402768:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305533.402799:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015198976:0@lo:400:kworker.0 00010000:00080000:2.0:1788305533.402831:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb22b480 x1875174015198592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305533.402846:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015198592:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788305533.402869:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355f80 x1875174015199104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305533.402879:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015199104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305533.403053:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015199488:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305533.403110:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015200000:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305533.403150:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305533.403155:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015199360:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403177:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305533.403194:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015199872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403213:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305533.403253:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199488 00000100:00100000:0.0:1788305533.403258:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199488 00000100:00100000:0.0:1788305533.403390:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200000 00000100:00100000:0.0:1788305533.403394:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200000 00000100:00100000:0.0:1788305533.403413:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199872 00000100:00100000:0.0:1788305533.403416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199872 00000100:00100000:0.0:1788305533.403432:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305533.403438:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015199488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403554:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015199488:12345-0@lo:400:kworker.0 Request processed in 115us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305533.403562:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788305533.403576:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305533.403583:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015200000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403611:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015200000:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305533.403616:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305533.403627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788305533.403632:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015199872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403655:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015199872:12345-0@lo:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305533.403660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788305533.403682:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199360 00000100:00100000:0.0:1788305533.403685:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199360 00000100:00100000:0.0:1788305533.403710:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305533.403716:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015199360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403746:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015199360:12345-0@lo:400:kworker.0 Request processed in 31us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305533.403760:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305533.403812:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015199360:0@lo:400:kworker.0 00010000:00080000:0.0:1788305533.403823:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082051880 x1875174015199872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305533.403831:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015199872:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403840:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015199488:0@lo:400:kworker.0 00000100:00100000:0.0:1788305533.403848:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015200000:0@lo:400:kworker.0 00000100:00080000:2.0:1788305533.404402:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305533.404407:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305533.404421:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015199616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.404555:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.404585:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015200128:0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.404610:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.404634:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788305533.404641:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015199232:0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.404663:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.404677:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015199744:0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.404697:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305533.404725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199616 00000100:00100000:2.0:1788305533.404730:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199616 00000100:00100000:2.0:1788305533.404760:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788305533.404766:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015199616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305533.404820:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015199616:12345-0@lo:400:kworker.0 Request processed in 53us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305533.404827:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788305533.404861:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015199616:0@lo:400:kworker.0 00010000:00080000:3.0:1788305533.405261:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb229180 x1875174015198848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305533.405397:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200128 00000100:00100000:1.0:1788305533.405403:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200128 00000100:00100000:1.0:1788305533.405439:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199232 00000100:00100000:1.0:1788305533.405442:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199232 00000100:00100000:1.0:1788305533.405453:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015199744 00000100:00100000:1.0:1788305533.405455:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015199744 00000100:00100000:1.0:1788305533.405495:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305533.405501:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015200128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305533.405544:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015200128:12345-0@lo:400:kworker.0 Request processed in 44us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305533.405550:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305533.405563:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788305533.405568:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015199232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305533.405594:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015199232:12345-0@lo:400:kworker.0 Request processed in 26us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305533.405599:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788305533.405610:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788305533.405615:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015199744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305533.405639:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015199744:12345-0@lo:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305533.405644:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788305533.405664:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305533.405667:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305533.405683:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015199232:0@lo:400:kworker.0 00000100:00100000:1.0:1788305533.405691:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015199744:0@lo:400:kworker.0 00010000:00080000:1.0:1788305533.405700:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053b80 x1875174015200128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305533.405708:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015200128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305533.406110:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015198848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788305534.037541:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305535.062077:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305535.445426:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015200256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305535.445504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305535.445643:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305535.445672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305535.445721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200256 00000100:00100000:3.0:1788305535.445728:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200256 00000100:00100000:3.0:1788305535.445780:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200384 00000100:00100000:3.0:1788305535.445784:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200384 00000100:00100000:3.0:1788305535.445801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305535.445820:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015200256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305535.445858:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305535.446045:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788305535.446055:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015200384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305535.446086:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305535.446127:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015200384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305535.446135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788305535.446178:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015200384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305535.447528:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015200256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1712us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.447549:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788305535.447694:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015200256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305535.600932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.600980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.601016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.601043:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.601067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.601093:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151040 00000100:00100000:3.0:1788305535.601101:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151040 00000100:00100000:3.0:1788305535.601493:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 309 00000100:00100000:3.0:1788305535.601504:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994151040:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305535.601574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994151040:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 73us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.601582:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 309 00000100:00100000:3.0:1788305535.601622:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151168 00000100:00100000:3.0:1788305535.601625:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151168 00000100:00100000:3.0:1788305535.601655:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151296 00000100:00100000:3.0:1788305535.601658:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151296 00000100:00100000:3.0:1788305535.601668:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151552 00000100:00100000:3.0:1788305535.601670:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151552 00000100:00100000:3.0:1788305535.601681:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 161 00000100:00100000:3.0:1788305535.601687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994151168:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305535.601713:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994151168:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.601719:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 161 00000100:00100000:3.0:1788305535.601730:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:3.0:1788305535.601735:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994151296:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305535.601756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994151296:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 21us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.601762:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:3.0:1788305535.601782:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00100000:3.0:1788305535.601798:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994151552:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305535.601821:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994151552:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.601827:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00080000:3.0:1788305535.601931:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305535.601935:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305535.602666:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151808 00000100:00100000:0.0:1788305535.602674:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151808 00000100:00100000:0.0:1788305535.602719:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788305535.602728:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994151808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305535.602781:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994151808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 55us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305535.602800:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00080000:0.0:1788305535.605683:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305535.620405:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.620467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305535.620503:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151680 00000100:00100000:1.0:1788305535.620610:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151424 00000100:00100000:1.0:1788305535.620616:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151424 00000100:00100000:1.0:1788305535.620685:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:1.0:1788305535.620696:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994151424:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305535.620804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994151424:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305535.620812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00080000:1.0:1788305535.620833:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305535.621070:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151680 00000100:00100000:3.0:1788305535.621169:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788305535.621177:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994151680:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:1.0:1788305535.621204:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305535.621210:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994151680:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305535.621217:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00010000:00010000:0.0:1788305536.085710:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305537.109638:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305538.134563:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305538.518877:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015200512:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.518977:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305538.519987:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200512 00000100:00100000:2.0:1788305538.519998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200512 00000100:00100000:2.0:1788305538.520059:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788305538.520069:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015200512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.520130:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015200512:12345-0@lo:400:kworker.0 Request processed in 64us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.520138:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788305538.520609:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082051880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015200512:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520621:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015201024:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520654:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520691:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015201536:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520713:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520740:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015202048:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520839:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015202560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305538.520863:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520881:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788305538.520887:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015200896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520939:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015201408:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520957:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.520972:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015201920:0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.520988:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.521000:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015202432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305538.521016:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.521054:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015200640:0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.521065:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201536 00000100:00100000:3.0:1788305538.521071:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201536 00000100:00100000:0.0:1788305538.521079:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.521098:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015201152:0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.521114:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202048 00000100:00100000:3.0:1788305538.521119:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202048 00000100:00100000:0.0:1788305538.521123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305538.521137:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201408 00000100:00100000:3.0:1788305538.521141:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201408 00000100:00100000:0.0:1788305538.521145:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015201664:0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.521158:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201920 00000100:00100000:3.0:1788305538.521162:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201920 00000100:00100000:0.0:1788305538.521183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305538.521187:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305538.521197:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015201536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.521208:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015202176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305538.521235:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305538.521255:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788305538.521261:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015201536:12345-0@lo:400:kworker.0 Request processed in 64us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305538.521266:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015200768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.521297:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305538.521317:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305538.521320:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305538.521329:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015202048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.521393:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201024 00000100:00100000:2.0:1788305538.521398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201024 00000100:00100000:2.0:1788305538.521422:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200768 00000100:00100000:2.0:1788305538.521431:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200768 00000100:00100000:2.0:1788305538.521448:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305538.521455:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015201024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.522967:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015202048:12345-0@lo:400:kworker.0 Request processed in 1632us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305538.522980:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305538.523011:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305538.523021:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015201408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.523064:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015201408:12345-0@lo:400:kworker.0 Request processed in 46us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305538.523080:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305538.523093:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788305538.523099:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015201920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.523131:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015201920:12345-0@lo:400:kworker.0 Request processed in 32us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305538.523137:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788305538.523163:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305538.523168:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305538.527195:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202560 00000100:00100000:3.0:1788305538.527208:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202560 00000100:00100000:3.0:1788305538.527242:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202432 00000100:00100000:3.0:1788305538.527243:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202432 00000100:00100000:3.0:1788305538.527250:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202176 00000100:00100000:3.0:1788305538.527251:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202176 00000100:00100000:3.0:1788305538.527264:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788305538.527271:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015202560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305538.527313:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305538.527370:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015201280:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.527414:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015201024:12345-0@lo:400:kworker.0 Request processed in 5958us (6758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305538.527422:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305538.527427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305538.527450:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788305538.527458:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015201792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.527464:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015200768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305538.527497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305538.527508:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015200768:12345-0@lo:400:kworker.0 Request processed in 50us (6192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.527513:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788305538.527519:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015202304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305538.527531:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788305538.527537:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015202432:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305538.527548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788305538.527552:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305538.527589:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015200768:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.527591:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015202432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (6572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.527602:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788305538.527618:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202304 00000100:00100000:2.0:1788305538.527621:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202304 00000100:00100000:2.0:1788305538.527639:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305538.527645:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015202176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305538.527659:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305538.527796:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015202176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (6559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.527803:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788305538.527814:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305538.527827:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015202304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305538.527835:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305538.527853:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015202304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.527857:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1788305538.527879:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485500 x1875174015202304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.527905:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015202304:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788305538.527918:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d46a00 x1875174015202176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.527929:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015202176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305538.529724:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200896 00000100:00100000:2.0:1788305538.529738:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200896 00000100:00100000:2.0:1788305538.529791:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015200640 00000100:00100000:2.0:1788305538.529794:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015200640 00000100:00100000:2.0:1788305538.529806:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201152 00000100:00100000:2.0:1788305538.529808:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201152 00000100:00100000:2.0:1788305538.529837:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201664 00000100:00100000:2.0:1788305538.529840:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201664 00000100:00100000:2.0:1788305538.529853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201280 00000100:00100000:2.0:1788305538.529856:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201280 00000100:00100000:2.0:1788305538.529867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015201792 00000100:00100000:2.0:1788305538.529870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015201792 00000100:00100000:2.0:1788305538.529885:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788305538.529894:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015200896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.529970:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015200896:12345-0@lo:400:kworker.0 Request processed in 77us (9047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.529993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788305538.530009:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788305538.530014:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015200640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530049:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015200640:12345-0@lo:400:kworker.0 Request processed in 35us (8970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.530056:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788305538.530068:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788305538.530074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015201152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082051880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015201152:12345-0@lo:400:kworker.0 Request processed in 27us (8978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.530106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788305538.530117:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788305538.530123:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015201664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530153:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015201664:12345-0@lo:400:kworker.0 Request processed in 30us (8971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.530158:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788305538.530169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788305538.530175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015201280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015201280:12345-0@lo:400:kworker.0 Request processed in 25us (2780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.530204:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788305538.530214:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788305538.530220:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015201792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530245:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015201792:12345-0@lo:400:kworker.0 Request processed in 26us (2760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305538.530257:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:2.0:1788305538.530358:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11f80 x1875174015201280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.530372:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015201280:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.530383:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa13100 x1875174015201792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.530390:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015201792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530400:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015200640:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530409:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015201152:0@lo:400:kworker.0 00000100:00100000:2.0:1788305538.530417:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015201664:0@lo:400:kworker.0 00000100:00080000:2.0:1788305538.530833:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305538.530838:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305538.533562:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015200896:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.533583:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa10000 x1875174015201408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.533594:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015201408:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.533606:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d15f80 x1875174015201920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.533613:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015201920:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.533623:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb487100 x1875174015202432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.533663:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015202432:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305538.533677:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015201024:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.533688:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa11880 x1875174015201536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.533696:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015201536:0@lo:400:kworker.0 00010000:00080000:2.0:1788305538.533707:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d17b80 x1875174015202048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305538.533713:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d17b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015202048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305538.534150:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015202560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6876us (13282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305538.534163:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788305538.534211:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485f80 x1875174015202560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305538.534227:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015202560:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788305539.158631:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305540.186586:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305540.568141:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305540.568181:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015202688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305540.568300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305540.568379:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202688 00000100:00100000:0.0:1788305540.568385:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202688 00000100:00100000:0.0:1788305540.568429:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788305540.568438:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015202688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305540.568639:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305540.568703:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015202688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 265us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305540.568734:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788305540.568787:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015202688:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788305540.570404:0:12510:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305540.570679:0:12510:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788305540.572231:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015202816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305540.572335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305540.575810:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202816 00000100:00100000:0.0:1788305540.575826:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202816 00000100:00100000:0.0:1788305540.575890:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788305540.575901:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015202816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305540.575941:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788305540.576045:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015202816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305540.576053:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788305540.576101:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015202816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305540.725016:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725106:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725177:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725212:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725264:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305540.725325:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152192 00000100:00100000:3.0:1788305540.725335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152192 00000100:00100000:3.0:1788305540.725384:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152448 00000100:00100000:3.0:1788305540.725387:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152448 00000100:00100000:3.0:1788305540.725401:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152064 00000100:00100000:3.0:1788305540.725403:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152064 00000100:00100000:3.0:1788305540.725414:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152320 00000100:00100000:3.0:1788305540.725416:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152320 00000100:00100000:3.0:1788305540.725432:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:3.0:1788305540.725441:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994152192:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725516:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994152192:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 75us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725524:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:3.0:1788305540.725541:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 172 00000100:00100000:3.0:1788305540.725548:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152448:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725571:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152448:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725577:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 172 00000100:00100000:3.0:1788305540.725587:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:3.0:1788305540.725593:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994152064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725612:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994152064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 19us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:3.0:1788305540.725637:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:3.0:1788305540.725643:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152320:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725667:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152320:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725674:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:3.0:1788305540.725692:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152704 00000100:00100000:3.0:1788305540.725695:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152704 00000100:00100000:3.0:1788305540.725731:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152576 00000100:00100000:3.0:1788305540.725734:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152576 00000100:00100000:3.0:1788305540.725755:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788305540.725762:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152704:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725786:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152704:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725792:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788305540.725802:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:3.0:1788305540.725808:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152576:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305540.725831:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994152576:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305540.725837:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00080000:3.0:1788305540.725862:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305540.725866:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305540.725868:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305540.725870:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305540.726325:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994151936 00000100:00100000:2.0:1788305540.726330:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994151936 00000100:00100000:2.0:1788305540.726358:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 311 00000100:00100000:2.0:1788305540.726365:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994151936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305540.726405:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994151936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 41us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305540.726412:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 311 00010000:00010000:1.0:1788305541.210890:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305542.231210:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788305542.603053:0:12608:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305542.603328:0:12608:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788305543.258210:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305543.637551:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015203200:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637628:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637686:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015203712:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637763:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637784:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015204224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637833:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788305543.637839:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015203328:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637873:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015203840:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637913:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637934:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015204352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.637953:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.637989:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203200 00000100:00100000:0.0:1788305543.637997:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203200 00000100:00100000:0.0:1788305543.638044:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788305543.638053:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015203200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.638104:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015203200:12345-0@lo:400:kworker.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.638111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788305543.638131:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203712 00000100:00100000:0.0:1788305543.638134:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203712 00000100:00100000:0.0:1788305543.638165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204224 00000100:00100000:0.0:1788305543.638167:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204224 00000100:00100000:0.0:1788305543.638180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203328 00000100:00100000:0.0:1788305543.638183:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203328 00000100:00100000:0.0:1788305543.638194:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788305543.638200:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015203712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.638230:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015203712:12345-0@lo:400:kworker.0 Request processed in 30us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.638236:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788305543.638248:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788305543.638253:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015204224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.638306:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015204224:12345-0@lo:400:kworker.0 Request processed in 52us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.638312:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788305543.638324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788305543.638338:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015203328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.638366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015203328:12345-0@lo:400:kworker.0 Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.638372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788305543.638392:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305543.638423:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015203328:0@lo:400:kworker.0 00000100:00100000:0.0:1788305543.638435:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015203200:0@lo:400:kworker.0 00010000:00080000:0.0:1788305543.638446:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053b80 x1875174015203712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305543.638455:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015203712:0@lo:400:kworker.0 00010000:00080000:0.0:1788305543.638463:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2300 x1875174015204224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305543.638471:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015204224:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638677:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015203072:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638746:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015203584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638766:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638782:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015204096:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638801:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638814:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788305543.638819:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015202944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638845:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638867:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015203456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638902:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015203968:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638922:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638937:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015204480:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.638956:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305543.638979:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203072 00000100:00100000:3.0:1788305543.638983:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203072 00000100:00100000:3.0:1788305543.639003:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203584 00000100:00100000:3.0:1788305543.639005:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203584 00000100:00100000:3.0:1788305543.639023:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204096 00000100:00100000:3.0:1788305543.639026:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204096 00000100:00100000:3.0:1788305543.639040:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788305543.639046:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015203072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639082:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015203072:12345-0@lo:400:kworker.0 Request processed in 37us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639088:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788305543.639100:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788305543.639113:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015203584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639139:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015203584:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639145:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788305543.639156:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788305543.639161:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015204096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639186:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015204096:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639191:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788305543.639212:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203840 00000100:00100000:3.0:1788305543.639215:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203840 00000100:00100000:3.0:1788305543.639233:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204352 00000100:00100000:3.0:1788305543.639236:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204352 00000100:00100000:3.0:1788305543.639246:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203968 00000100:00100000:3.0:1788305543.639248:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203968 00000100:00100000:3.0:1788305543.639259:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204480 00000100:00100000:3.0:1788305543.639262:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204480 00000100:00100000:3.0:1788305543.639292:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305543.639301:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015203840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639337:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015203840:12345-0@lo:400:kworker.0 Request processed in 38us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639343:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305543.639353:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305543.639359:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015204352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639386:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015204352:12345-0@lo:400:kworker.0 Request processed in 28us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639392:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305543.639410:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305543.639416:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015203968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639442:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015203968:12345-0@lo:400:kworker.0 Request processed in 27us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639448:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305543.639472:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305543.639478:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015204480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639504:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015204480:12345-0@lo:400:kworker.0 Request processed in 28us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639510:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305543.639532:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015202944 00000100:00100000:3.0:1788305543.639536:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015202944 00000100:00100000:3.0:1788305543.639561:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788305543.639567:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015202944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639594:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015202944:12345-0@lo:400:kworker.0 Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639600:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788305543.639626:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015203456 00000100:00100000:3.0:1788305543.639629:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015203456 00000100:00100000:3.0:1788305543.639649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788305543.639654:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015203456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639681:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015203456:12345-0@lo:400:kworker.0 Request processed in 27us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305543.639687:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1788305543.639736:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305543.639741:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305543.639743:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305543.639774:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015202944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639786:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082052d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015203456:0@lo:400:kworker.0 00010000:00080000:3.0:1788305543.639798:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082050700 x1875174015203968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305543.639807:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015203968:0@lo:400:kworker.0 00010000:00080000:3.0:1788305543.639816:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e0e00 x1875174015204480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305543.639824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015204480:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639833:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015203072:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639842:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015203584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305543.639850:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015204096:0@lo:400:kworker.0 00010000:00080000:3.0:1788305543.639888:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082050e00 x1875174015203840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305543.639897:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082050e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015203840:0@lo:400:kworker.0 00010000:00080000:3.0:1788305543.639908:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e1f80 x1875174015204352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305543.639915:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015204352:0@lo:400:kworker.0 00000100:00100000:2.0:1788305543.640174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305543.640185:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015204608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305543.640217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305543.640248:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204608 00000100:00100000:2.0:1788305543.640252:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204608 00000100:00100000:2.0:1788305543.640306:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788305543.640313:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015204608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305543.640334:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305543.640377:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015204608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305543.640384:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788305543.640412:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb487100 x1875174015204608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305543.640426:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015204608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305543.640524:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015204864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305543.640550:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.640578:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305543.640584:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015204736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305543.640605:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305543.640628:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204864 00000100:00100000:0.0:1788305543.640632:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204864 00000100:00100000:0.0:1788305543.640651:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204736 00000100:00100000:0.0:1788305543.640654:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204736 00000100:00100000:0.0:1788305543.640665:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305543.640671:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015204864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305543.640707:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305543.640740:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015204864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.640747:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305543.640759:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788305543.640765:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015204736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305543.640774:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305543.640800:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015204736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305543.640804:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1788305543.640828:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb485500 x1875174015204736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305543.640839:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015204736:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788305543.640848:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2300 x1875174015204864/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305543.640857:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015204864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305543.641419:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305543.641429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015204992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305543.641550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305543.641622:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015204992 00000100:00100000:2.0:1788305543.641627:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015204992 00000100:00100000:2.0:1788305543.641663:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305543.641671:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015204992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305543.641684:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305543.641727:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015204992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305543.641733:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1788305543.641798:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268380 x1875174015204992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305543.641824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015204992:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788305544.277449:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305544.845933:0:12706:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305544.846166:0:12706:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305545.301460:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305545.686108:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305545.686135:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015205120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305545.686207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305545.686271:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205120 00000100:00100000:0.0:1788305545.686301:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205120 00000100:00100000:0.0:1788305545.686346:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788305545.686354:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015205120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305545.686388:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305545.686450:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015205120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305545.686457:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788305545.686514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015205120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305545.690362:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015205248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305545.690440:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305545.690748:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205248 00000100:00100000:1.0:1788305545.690757:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205248 00000100:00100000:1.0:1788305545.690814:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305545.690835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015205248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305545.690880:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305545.690934:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015205248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305545.690960:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788305545.691051:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015205248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305545.848021:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848063:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848094:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848115:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848150:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305545.848184:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305545.848272:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152832 00000100:00100000:0.0:1788305545.848298:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152832 00000100:00100000:0.0:1788305545.848348:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 313 00000100:00100000:0.0:1788305545.848359:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994152832:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305545.848428:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994152832:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 70us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305545.848437:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 313 00000100:00100000:3.0:1788305545.848541:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994152960 00000100:00100000:3.0:1788305545.848546:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994152960 00000100:00100000:3.0:1788305545.848589:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153088 00000100:00100000:3.0:1788305545.848592:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153088 00000100:00100000:3.0:1788305545.848607:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153216 00000100:00100000:3.0:1788305545.848621:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153216 00000100:00100000:3.0:1788305545.848636:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153344 00000100:00100000:3.0:1788305545.848638:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153344 00000100:00080000:0.0:1788305545.848645:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305545.848652:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305545.848657:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:3.0:1788305545.848665:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994152960:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305545.848713:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994152960:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 49us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.848720:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:3.0:1788305545.848731:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:3.0:1788305545.848737:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994153088:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305545.848759:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994153088:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.848764:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:3.0:1788305545.848774:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:3.0:1788305545.848779:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994153216:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305545.848798:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994153216:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 19us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.848816:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:3.0:1788305545.848832:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:3.0:1788305545.848838:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994153344:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305545.848865:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994153344:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.848873:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:3.0:1788305545.848917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153472 00000100:00100000:3.0:1788305545.848920:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153472 00000100:00100000:3.0:1788305545.848963:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153600 00000100:00100000:3.0:1788305545.848966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153600 00000100:00100000:3.0:1788305545.848996:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788305545.849005:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2394:x1875173994153472:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305545.849026:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60535de 00000100:00080000:3.0:1788305545.849037:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8891bf99d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305545.849084:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788305545.849222:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+2:2394:x1875173994153472:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 218us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.849231:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:3.0:1788305545.849252:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788305545.849261:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2394:x1875173994153600:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305545.849298:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60535e5 00000100:00080000:3.0:1788305545.849307:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8890825d3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305545.849334:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788305545.849428:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+2:2394:x1875173994153600:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 167us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305545.849602:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00010000:00010000:3.0:1788305545.850174:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305545.850183:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305545.850192:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305545.850197:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788305546.327244:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305547.265917:0:12803:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305547.267703:0:12803:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788305547.354830:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305548.382882:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305548.757447:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305548.757515:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.757575:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205376 00000100:00100000:0.0:1788305548.757582:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205376 00000100:00100000:0.0:1788305548.757624:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305548.757630:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015205376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305548.757666:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305548.757714:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015205376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.757721:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788305548.757740:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305548.757776:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e1f80 x1875174015205376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305548.757780:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305548.757800:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015205504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305548.757800:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015205376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305548.757837:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305548.757953:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015205632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.757982:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305548.758003:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015206144:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758045:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205504 00000100:00100000:0.0:1788305548.758049:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205504 00000100:00100000:3.0:1788305548.758051:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015206656:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758075:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758076:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788305548.758083:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015205504:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305548.758093:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788305548.758097:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015206016:0@lo:400:kworker.0 00002000:00000024:0.0:1788305548.758099:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305548.758118:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758123:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015205504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.758129:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788305548.758145:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015205760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305548.758251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206144 00000100:00100000:1.0:1788305548.758255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206144 00000100:00100000:1.0:1788305548.758300:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788305548.758307:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015206144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305548.758343:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015206144:12345-0@lo:400:kworker.0 Request processed in 37us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305548.758349:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788305548.758461:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305548.758472:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015205888:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758560:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015206400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758579:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015206528:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758582:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015206912:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206656 00000100:00100000:0.0:1788305548.758624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206656 00000100:00100000:3.0:1788305548.758632:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015207040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305548.758664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206016 00000100:00100000:0.0:1788305548.758669:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206016 00000100:00100000:0.0:1788305548.758681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206400 00000100:00100000:0.0:1788305548.758683:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206400 00000100:00100000:3.0:1788305548.758688:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015206144:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00010000:00080000:3.0:1788305548.758699:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268380 x1875174015205504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305548.758700:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015206656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758722:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015205504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305548.758741:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015206656:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758742:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015206656:12345-0@lo:400:kworker.0 Request processed in 42us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.758748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788305548.758760:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205632 00000100:00100000:0.0:1788305548.758760:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788305548.758763:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205632 00000100:00100000:0.0:1788305548.758766:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015206016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758795:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015206016:12345-0@lo:400:kworker.0 Request processed in 29us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.758801:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788305548.758802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1788305548.758808:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015205632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.758810:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788305548.758815:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015206400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.758836:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015205632:12345-0@lo:400:kworker.0 Request processed in 29us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.758836:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015206400:12345-0@lo:400:kworker.0 Request processed in 21us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305548.758842:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788305548.758842:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788305548.758862:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207040 00000100:00100000:0.0:1788305548.758865:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207040 00000100:00100000:3.0:1788305548.758871:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206528 00000100:00100000:3.0:1788305548.758873:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206528 00000100:00100000:0.0:1788305548.758886:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788305548.758892:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015207040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305548.758893:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788305548.758898:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015206528:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788305548.758902:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305548.758926:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015206528:12345-0@lo:400:kworker.0 Request processed in 27us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.758926:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015207040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305548.758932:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788305548.758932:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788305548.758944:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305548.758947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305548.758949:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305548.758951:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305548.758959:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.758989:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015206272:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759011:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305548.759028:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015206784:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.759042:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205760 00000100:00100000:3.0:1788305548.759045:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205760 00000100:00100000:0.0:1788305548.759047:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305548.759062:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206272 00000100:00100000:3.0:1788305548.759065:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206272 00000100:00100000:0.0:1788305548.759072:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206784 00000100:00100000:0.0:1788305548.759075:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206784 00000100:00100000:3.0:1788305548.759083:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788305548.759089:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015205760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759091:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788305548.759096:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015206272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.759120:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015205760:12345-0@lo:400:kworker.0 Request processed in 31us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.759128:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015206272:12345-0@lo:400:kworker.0 Request processed in 32us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305548.759138:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788305548.759146:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788305548.759156:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788305548.759165:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015206784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759262:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082050700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015206784:12345-0@lo:400:kworker.0 Request processed in 100us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305548.759292:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788305548.759305:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305548.759308:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305548.759328:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015205760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759338:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015206272:0@lo:400:kworker.0 00010000:00080000:0.0:1788305548.759347:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083755500 x1875174015206784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305548.759355:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015206784:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759376:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305548.759494:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb26ad80 x1875174015206400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305548.759510:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015206400:0@lo:400:kworker.0 00000100:00100000:0.0:1788305548.759536:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015206016:0@lo:400:kworker.0 00010000:00080000:0.0:1788305548.759546:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb269c00 x1875174015206528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305548.759554:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb269c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015206528:0@lo:400:kworker.0 00010000:00080000:0.0:1788305548.759564:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890826fd500 x1875174015207040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305548.759575:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015207040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305548.759584:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015205632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.759680:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015206912 00000100:00100000:3.0:1788305548.759684:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015206912 00000100:00100000:3.0:1788305548.759719:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788305548.759727:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015206912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.759768:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015206912:12345-0@lo:400:kworker.0 Request processed in 42us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305548.759775:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788305548.759797:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083754000 x1875174015206912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305548.759806:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015206912:0@lo:400:kworker.0 00000100:00100000:1.0:1788305548.760245:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015205888 00000100:00100000:1.0:1788305548.760250:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015205888 00000100:00100000:1.0:1788305548.760297:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788305548.760304:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015205888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305548.760345:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015205888:12345-0@lo:400:kworker.0 Request processed in 43us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305548.760351:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788305548.760375:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015205888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305548.761973:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015207168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305548.762033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305548.762316:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207168 00000100:00100000:1.0:1788305548.762324:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207168 00000100:00100000:1.0:1788305548.762448:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788305548.762458:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015207168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305548.762481:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305548.762533:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015207168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305548.762540:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788305548.762559:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053b80 x1875174015207168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305548.762577:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015207168:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788305549.403459:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788305549.416942:0:12901:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305549.417395:0:12901:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305550.427831:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305550.806340:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015207296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305550.806435:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305550.806534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207296 00000100:00100000:3.0:1788305550.806545:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207296 00000100:00100000:3.0:1788305550.806610:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788305550.806620:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015207296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305550.806679:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305550.806736:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015207296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305550.806743:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788305550.806812:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083756d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015207296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305550.808039:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015207424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305550.808115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305550.808611:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207424 00000100:00100000:0.0:1788305550.808620:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207424 00000100:00100000:0.0:1788305550.808688:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788305550.808699:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015207424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305550.808741:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305550.813302:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015207424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4579us (5170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305550.813321:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788305550.824615:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015207424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305550.966488:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305550.966524:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305550.966547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305550.966577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305550.966906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305550.967021:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153984 00000100:00100000:0.0:1788305550.967031:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153984 00000100:00100000:1.0:1788305550.967061:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154240 00000100:00100000:1.0:1788305550.967066:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154240 00000100:00100000:1.0:1788305550.967098:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153856 00000100:00100000:1.0:1788305550.967101:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153856 00000100:00100000:0.0:1788305550.967107:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:0.0:1788305550.967121:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994153984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305550.967123:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:1.0:1788305550.967132:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994154240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305550.967213:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083757b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994154240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 81us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305550.967216:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994153984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 96us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305550.967225:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:0.0:1788305550.967233:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:1.0:1788305550.967245:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:1.0:1788305550.967254:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994153856:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:0.0:1788305550.967262:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305550.967268:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305550.967295:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994153856:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305550.967302:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:0.0:1788305550.967321:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994153728 00000100:00100000:0.0:1788305550.967326:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994153728 00000100:00100000:0.0:1788305550.967359:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 315 00000100:00100000:0.0:1788305550.967369:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994153728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305550.967401:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994153728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305550.967409:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 315 00000100:00100000:0.0:1788305550.969532:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154112 00000100:00100000:0.0:1788305550.969544:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154112 00000100:00100000:0.0:1788305550.969616:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:0.0:1788305550.969626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994154112:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305550.969714:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994154112:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 89us (2808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305550.969722:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00080000:1.0:1788305550.970169:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305551.459185:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788305551.835559:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000020:00000080:3.0:1788305551.835573:0:8431:0:(genops.c:885:class_export_put()) final put ffff8891bf99e800/c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:0.0:1788305551.837737:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000020:00000080:0.0:1788305551.838291:0:9516:0:(genops.c:885:class_export_put()) final put ffff8890825d0800/c1c667bf-adbd-4039-9541-664be6dfc9fd 00000020:00000080:2.0:1788305551.842640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf99e800/c1c667bf-adbd-4039-9541-664be6dfc9fd for lustre-OST0000 00000020:00000080:2.0:1788305551.842759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8890825d0800/c1c667bf-adbd-4039-9541-664be6dfc9fd for lustre-OST0001 00000020:00000080:2.0:1788305551.842785:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf99d800 for lustre-OST0000 00000020:00000080:2.0:1788305551.842790:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890825d3800 for lustre-OST0001 00010000:00010000:2.0:1788305552.469604:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305553.494371:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305553.878688:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015207552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305553.878759:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305553.878837:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207552 00000100:00100000:3.0:1788305553.878845:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207552 00000100:00100000:3.0:1788305553.878914:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788305553.878924:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015207552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305553.878964:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305553.879011:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015207552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305553.879018:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788305553.879039:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305553.879069:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb26bb80 x1875174015207552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305553.879108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015207552:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305553.879226:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305553.879242:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015207680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305553.879272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.879318:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207680 00000100:00100000:2.0:1788305553.879322:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207680 00000100:00100000:2.0:1788305553.879353:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305553.879360:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015207680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305553.879370:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305553.879401:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb484700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015207680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.879408:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788305553.879421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305553.879439:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb487100 x1875174015207680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.879451:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015207680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305553.880933:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015207936:0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.881001:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305553.881039:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015208448:0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.881060:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881063:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015207808:0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.881077:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015208960:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881094:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305553.881100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881121:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015208320:0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.881139:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207936 00000100:00100000:2.0:1788305553.881142:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305553.881144:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207936 00000100:00100000:2.0:1788305553.881159:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015208832:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881177:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305553.881183:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208448 00000100:00100000:3.0:1788305553.881186:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208448 00000100:00100000:2.0:1788305553.881202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208832 00000100:00100000:2.0:1788305553.881205:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208832 00000100:00100000:3.0:1788305553.881212:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788305553.881220:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015207936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881221:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788305553.881227:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015208448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305553.881359:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208320 00000100:00100000:1.0:1788305553.881363:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208320 00000100:00100000:1.0:1788305553.881394:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788305553.881401:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015208320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305553.881457:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015208320:12345-0@lo:400:kworker.0 Request processed in 56us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305553.881476:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788305553.881498:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208960 00000100:00100000:1.0:1788305553.881502:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208960 00000100:00100000:1.0:1788305553.881526:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305553.881533:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015208960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015208448:12345-0@lo:400:kworker.0 Request processed in 40us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.881628:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788305553.881642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788305553.881648:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015208832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881676:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015208832:12345-0@lo:400:kworker.0 Request processed in 29us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.881682:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788305553.881699:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015209344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305553.881724:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881756:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015208320:0@lo:400:kworker.0 00010000:00080000:2.0:1788305553.881769:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5180 x1875174015208832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.881779:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015208832:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881820:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015208064:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881878:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015208576:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881899:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881913:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015209088:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881950:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305553.881956:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015208192:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.881983:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.881993:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015208704:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882012:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.882031:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015209216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305553.882049:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305553.882073:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208064 00000100:00100000:2.0:1788305553.882076:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208064 00000100:00100000:2.0:1788305553.882109:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788305553.882115:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015208064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882148:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015208064:12345-0@lo:400:kworker.0 Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788305553.882170:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209344 00000100:00100000:2.0:1788305553.882175:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209344 00000100:00100000:2.0:1788305553.882193:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209216 00000100:00100000:2.0:1788305553.882195:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209216 00000100:00100000:2.0:1788305553.882208:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305553.882214:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015209344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305553.882235:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305553.882270:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb485f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015209344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882297:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305553.882308:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305553.882314:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015209216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305553.882322:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305553.882344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015209216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882349:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788305553.882374:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356ce00 x1875174015209344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.882400:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015209344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305553.882420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208576 00000100:00100000:2.0:1788305553.882424:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208576 00000100:00100000:2.0:1788305553.882441:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208192 00000100:00100000:2.0:1788305553.882444:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208192 00000100:00100000:2.0:1788305553.882453:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015208704 00000100:00100000:2.0:1788305553.882455:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015208704 00000100:00100000:2.0:1788305553.882468:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305553.882473:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015208576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015208576:12345-0@lo:400:kworker.0 Request processed in 28us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882506:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305553.882517:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788305553.882522:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015208192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882545:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015208192:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882550:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788305553.882560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788305553.882566:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015208704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882590:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015208704:12345-0@lo:400:kworker.0 Request processed in 24us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305553.882595:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788305553.882652:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015208192:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.882660:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015208704:0@lo:400:kworker.0 00010000:00080000:2.0:1788305553.882677:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082053b80 x1875174015209216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.882688:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015209216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305553.882696:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015208064:0@lo:400:kworker.0 00010000:00080000:2.0:1788305553.882704:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5f80 x1875174015208576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.882711:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015208576:0@lo:400:kworker.0 00000100:00080000:2.0:1788305553.882759:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305553.882763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305553.882765:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305553.886444:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015207936:12345-0@lo:400:kworker.0 Request processed in 5205us (5423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305553.886459:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788305553.886512:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209088 00000100:00100000:3.0:1788305553.886520:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209088 00000100:00100000:3.0:1788305553.886573:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788305553.886582:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015209088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.886668:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015209088:12345-0@lo:400:kworker.0 Request processed in 87us (4734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305553.886675:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1788305553.886728:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5500 x1875174015209088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305553.886776:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015209088:0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.888978:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015207808 00000100:00100000:3.0:1788305553.888993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015207808 00000100:00100000:3.0:1788305553.889057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788305553.889067:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015207808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305553.889164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015207808:12345-0@lo:400:kworker.0 Request processed in 98us (8068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305553.889171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788305553.893064:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015207936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.893102:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015207808:0@lo:400:kworker.0 00000100:00100000:2.0:1788305553.893153:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015208448:0@lo:400:kworker.0 00000100:00100000:1.0:1788305553.895660:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015208960:12345-0@lo:400:kworker.0 Request processed in 14118us (14548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305553.895674:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000001:02000400:1.0:1788305553.897069:0:13045:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00080000:2.0:1788305553.899820:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b6a00 x1875174015208960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305553.899839:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015208960:0@lo:400:kworker.0 00010000:00010000:3.0:1788305554.517531:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305555.560108:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305555.930888:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015209600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305555.931007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305555.931117:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209600 00000100:00100000:2.0:1788305555.931126:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209600 00000100:00100000:2.0:1788305555.931182:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788305555.931207:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015209600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305555.931306:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788305555.931925:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015209600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 721us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305555.931935:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788305555.932232:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015209600:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305555.932773:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015209472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305555.932832:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305555.932886:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209472 00000100:00100000:3.0:1788305555.932893:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209472 00000100:00100000:3.0:1788305555.933009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788305555.933020:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015209472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305555.933058:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305555.933188:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015209472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305555.933196:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788305555.933233:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015209472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305556.081659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305556.081701:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305556.082461:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154496 00000100:00100000:0.0:1788305556.082474:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154496 00000100:00100000:0.0:1788305556.082538:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154752 00000100:00100000:0.0:1788305556.082541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154752 00000100:00100000:0.0:1788305556.082569:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:0.0:1788305556.082579:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2397:x1875173994154496:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305556.082683:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2397:x1875173994154496:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 106us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305556.082692:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:2.0:1788305556.082716:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:2.0:1788305556.082744:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994154752:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305556.082816:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994154752:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305556.082899:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305556.082978:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305556.083073:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305556.083169:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154368 00000100:00100000:1.0:1788305556.083174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154368 00000100:00100000:1.0:1788305556.083206:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 317 00000100:00100000:1.0:1788305556.083216:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994154368:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305556.083256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994154368:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305556.083263:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 317 00000100:00100000:1.0:1788305556.083382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154624 00000100:00100000:1.0:1788305556.083386:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154624 00000100:00080000:3.0:1788305556.088613:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305556.088625:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305556.088648:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994154880 00000100:00100000:3.0:1788305556.088661:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994154880 00000100:00100000:2.0:1788305556.091665:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00080000:2.0:1788305556.091772:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305556.094153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:1.0:1788305556.094175:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994154624:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305556.094258:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994154624:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 93us (11279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305556.094272:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:3.0:1788305556.095056:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:3.0:1788305556.095091:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994154880:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305556.095149:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994154880:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 63us (12075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305556.095157:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 204 00010000:00010000:3.0:1788305556.565483:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305557.589550:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788305558.280978:0:13193:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd750a4b80 20000000:00000080:2.0:1788305558.281005:0:13193:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889083c72000 uarg=0000000000000000 20000000:01000000:2.0:1788305558.281069:0:13193:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305558.281077:0:13193:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305558.281083:0:13193:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788305558.283205:0:13194:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788305558.284051:0:13193:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788305558.289914:0:13193:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788305558.289954:0:13193:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.289980:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605357c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.289989:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605358a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.289996:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053598 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290003:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60535a6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290014:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290022:0:13193:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290030:0:13193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290090:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290126:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 12 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290144:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209728:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305558.290314:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290323:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290331:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209856:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305558.290359:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290367:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 23 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290376:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209984:0@lo:104: 00000100:00100000:0.0:1788305558.290421:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305558.290461:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290469:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 23 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290477:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210112:0@lo:104: 00000100:00100000:0.0:1788305558.290494:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305558.290521:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605358a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290529:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605358a expref: 23 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290538:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210240:0@lo:104: 00000100:00100000:0.0:1788305558.290557:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305558.290584:0:13193:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605357c expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305558.290592:0:13193:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605357c expref: 23 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.290601:0:13193:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210368:0@lo:104: 00000100:00100000:0.0:1788305558.290617:0:13193:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305558.290627:0:13193:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305558.290838:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015209984 00000100:00100000:2.0:1788305558.290848:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015209984 00000100:00100000:2.0:1788305558.290901:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210112 00000100:00100000:2.0:1788305558.290904:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210112 00000100:00100000:2.0:1788305558.290916:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210240 00000100:00100000:2.0:1788305558.290919:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210240 00000100:00100000:2.0:1788305558.290926:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210368 00000100:00100000:2.0:1788305558.290928:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210368 00000100:00100000:2.0:1788305558.290942:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788305558.290953:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:13193:x1875174015209984:12345-0@lo:104: 00010000:00010000:2.0:1788305558.290980:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291041:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788305558.291047:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+6:13193:x1875174015209984:12345-0@lo:104: Request processed in 96us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.291055:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788305558.291076:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788305558.291081:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:13193:x1875174015210112:12345-0@lo:104: 00010000:00010000:2.0:1788305558.291088:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291116:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788305558.291120:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+5:13193:x1875174015210112:12345-0@lo:104: Request processed in 40us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.291126:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788305558.291137:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788305558.291142:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:13193:x1875174015210240:12345-0@lo:104: 00010000:00010000:2.0:1788305558.291148:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291173:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788305558.291178:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:13193:x1875174015210240:12345-0@lo:104: Request processed in 36us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.291183:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788305558.291192:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305558.291196:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:13193:x1875174015210368:12345-0@lo:104: 00010000:00010000:2.0:1788305558.291209:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291234:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788305558.291239:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:13193:x1875174015210368:12345-0@lo:104: Request processed in 43us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.291246:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788305558.291270:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788305558.291293:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788305558.291301:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291301:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291314:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305558.291318:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291334:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305558.291343:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305558.291349:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305558.291381:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291387:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305558.291408:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291416:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183565200/0x4a426866e6053598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e605359f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291448:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305558.291451:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291458:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305558.291461:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291468:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305558.291475:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305558.291480:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788305558.291493:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291498:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305558.291515:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291521:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b600/0x4a426866e605358a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053591 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291529:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305558.291532:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305558.291549:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305558.291556:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291579:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc13b5c20) 00010000:00010000:3.0:1788305558.291581:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305558.291586:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305558.291596:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291600:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305558.291606:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:2.0:1788305558.291615:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305558.291622:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788305558.291631:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305558.291639:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788305558.291642:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305558.291648:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291651:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305558.291660:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181518600/0x4a426866e60535a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60535ad expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291662:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291674:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb000/0x4a426866e605357c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053583 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.291696:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305558.291697:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305558.291699:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305558.291724:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015210496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.291761:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.291796:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305558.291801:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015210880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.291830:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.291859:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015210624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.291883:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.291903:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305558.291908:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015210752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.291931:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.291957:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210496 00000100:00100000:2.0:1788305558.291963:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210496 00010000:00010000:2.0:1788305558.291987:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 24 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.292012:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210880 00000100:00100000:2.0:1788305558.292015:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210880 00010000:00010000:2.0:1788305558.292027:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605357c expref: 25 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.292037:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210624 00000100:00100000:2.0:1788305558.292040:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210624 00010000:00010000:2.0:1788305558.292050:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605358a expref: 26 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.292059:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015210752 00000100:00100000:2.0:1788305558.292061:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015210752 00010000:00010000:2.0:1788305558.292071:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 27 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.292084:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305558.292090:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+27:3648:x1875174015210496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.292103:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.292108:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 27 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292126:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 27 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292148:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.292180:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+27:3648:x1875174015210496:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.292187:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305558.292204:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305558.292210:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+26:3648:x1875174015210880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.292219:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.292223:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605357c expref: 26 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292231:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605357c expref: 26 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292241:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.292261:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+26:3648:x1875174015210880:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.292267:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305558.292310:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305558.292318:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+25:3649:x1875174015210624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.292326:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.292330:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605358a expref: 25 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292338:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605358a expref: 25 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292357:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.292388:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+25:3649:x1875174015210624:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.292395:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305558.292408:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305558.292415:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015210752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.292423:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.292427:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 24 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292435:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 24 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.292445:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.292464:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015210752:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.292470:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305558.292522:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015210752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.292531:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082053b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015210624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.292580:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015210880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305558.292589:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015210496:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.292636:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305558.293804:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305558.293807:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305558.293809:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305558.294042:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209728:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305558.294062:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564400/0x4a426866e60535ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60535a6 expref: 23 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.294075:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209984:0@lo:104: 00010000:00010000:0.0:1788305558.294087:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb200/0x4a426866e605359f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053598 expref: 22 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.294096:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210112:0@lo:104: 00010000:00010000:0.0:1788305558.294107:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518c00/0x4a426866e6053591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605358a expref: 21 pid: 6512 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.294115:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210240:0@lo:104: 00010000:00010000:0.0:1788305558.294137:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a200/0x4a426866e6053583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605357c expref: 20 pid: 6513 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305558.294145:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015210368:0@lo:104: 00000100:00100000:0.0:1788305558.295557:0:13193:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13193:1875174015209856:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305558.295623:0:13193:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305558.302256:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305558.305014:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155008 00000100:00100000:2.0:1788305558.305037:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155008 00010000:00010000:2.0:1788305558.305107:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.305161:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788305558.305172:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994155008:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.305190:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.305197:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.305213:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.305237:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518800/0x4a426866e60535c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08314 expref: 13 pid: 6512 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.305257:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.305358:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:2395:x1875173994155008:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 188us (3119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.305366:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788305558.309618:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305558.309708:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155136 00000100:00100000:2.0:1788305558.309723:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155136 00010000:00010000:2.0:1788305558.309775:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305558.309826:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305558.309839:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:2395:x1875173994155136:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305558.309857:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305558.309883:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309898:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309921:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb600/0x4a426866e60535b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082d5 expref: 12 pid: 6513 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309944:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309953:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309975:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309981:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309988:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.309995:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.310001:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305558.310006:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.310015:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.310052:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.310066:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305558.310141:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994155136:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 306us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.310150:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00010000:00010000:1.0:1788305558.310349:0:13193:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305558.310361:0:13193:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305558.310368:0:13193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523b800/0x4a426866e60535ec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305558.613667:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305558.997649:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305558.997690:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015211008:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305558.997792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.997887:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211008 00000100:00100000:2.0:1788305558.997898:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211008 00000100:00100000:2.0:1788305558.997964:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788305558.997978:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015211008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305558.998019:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305558.998074:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015211008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305558.998081:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788305558.998106:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788305558.998145:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891b8d46a00 x1875174015211008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305558.998166:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015211008:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305558.998635:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305558.998652:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015211136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305558.998842:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305558.999311:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211136 00000100:00100000:3.0:1788305558.999317:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211136 00000100:00100000:3.0:1788305558.999375:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788305558.999385:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015211136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305558.999405:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305558.999453:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015211136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305558.999459:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788305558.999478:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305558.999839:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015211648:0@lo:400:kworker.0 00000100:00100000:2.0:1788305558.999882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.999932:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015212160:0@lo:400:kworker.0 00000100:00100000:2.0:1788305558.999957:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305558.999984:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015212672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305559.000007:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000029:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788305559.000034:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015211264:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000061:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000078:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015211776:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000115:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015212288:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000131:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000156:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211776 00000100:00100000:2.0:1788305559.000161:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211776 00000100:00100000:2.0:1788305559.000196:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305559.000205:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015211776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000253:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015211776:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305559.000260:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305559.000319:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212672 00000100:00100000:2.0:1788305559.000323:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212672 00000100:00100000:2.0:1788305559.000353:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788305559.000360:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015212672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305559.000380:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305559.000413:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015212672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305559.000419:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788305559.000448:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015211392:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000497:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015211904:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000517:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000533:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015212416:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.000572:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.000594:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305559.000600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015211520:0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.000789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211648 00000100:00100000:3.0:1788305559.000795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211648 00000100:00100000:3.0:1788305559.000820:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211392 00000100:00100000:3.0:1788305559.000823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211392 00000100:00100000:3.0:1788305559.000832:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211904 00000100:00100000:3.0:1788305559.000834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211904 00000100:00100000:3.0:1788305559.000846:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212416 00000100:00100000:3.0:1788305559.000848:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212416 00000100:00100000:3.0:1788305559.000860:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788305559.000867:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015211648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.000903:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015211648:12345-0@lo:400:kworker.0 Request processed in 37us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.000909:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788305559.000919:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788305559.000924:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015211392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.000944:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015211392:12345-0@lo:400:kworker.0 Request processed in 20us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.000957:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788305559.000970:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788305559.000975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015211904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082053b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015211904:12345-0@lo:400:kworker.0 Request processed in 26us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.001007:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788305559.001018:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788305559.001024:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015212416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015212416:12345-0@lo:400:kworker.0 Request processed in 21us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.001049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788305559.001067:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212160 00000100:00100000:3.0:1788305559.001070:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212160 00000100:00100000:3.0:1788305559.001093:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212288 00000100:00100000:3.0:1788305559.001095:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212288 00000100:00100000:3.0:1788305559.001107:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788305559.001113:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015212160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001138:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015212160:12345-0@lo:400:kworker.0 Request processed in 25us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.001144:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788305559.001152:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305559.001157:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015212288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001178:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015212288:12345-0@lo:400:kworker.0 Request processed in 20us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.001183:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788305559.001214:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211264 00000100:00100000:3.0:1788305559.001218:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211264 00000100:00100000:3.0:1788305559.001244:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788305559.001250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015211264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001305:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015211264:12345-0@lo:400:kworker.0 Request processed in 55us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.001312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00080000:3.0:1788305559.001357:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305559.001363:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305559.001422:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015211264:0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001438:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015211776:0@lo:400:kworker.0 00010000:00080000:3.0:1788305559.001451:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d39f80 x1875174015212288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305559.001462:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015212288:0@lo:400:kworker.0 00000100:00100000:3.0:1788305559.001475:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015211648:0@lo:400:kworker.0 00010000:00080000:3.0:1788305559.001486:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d3b480 x1875174015212160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305559.001494:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015212160:0@lo:400:kworker.0 00010000:00080000:3.0:1788305559.001503:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb268380 x1875174015212672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305559.001518:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015212672:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788305559.001830:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38380 x1875174015211136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305574 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305559.001847:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015211136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305559.002092:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015212800:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305559.002136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305559.002410:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212800 00000100:00100000:0.0:1788305559.002416:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212800 00000100:00100000:0.0:1788305559.002465:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788305559.002475:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015212800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305559.002493:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305559.002543:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015212800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305559.002549:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:1.0:1788305559.004038:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c380 x1875174015212800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305559.004071:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015212800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305559.004337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.004403:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015212032:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.004453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.004484:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015212544:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.004508:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305559.004542:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015211392:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.004565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015211904:0@lo:400:kworker.0 00000100:00100000:2.0:1788305559.004580:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015212416:0@lo:400:kworker.0 00000100:00100000:1.0:1788305559.005354:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212032 00000100:00100000:1.0:1788305559.005366:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212032 00000100:00100000:1.0:1788305559.005447:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212544 00000100:00100000:1.0:1788305559.005451:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212544 00000100:00100000:1.0:1788305559.005479:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788305559.005489:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015212032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305559.005589:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015212032:12345-0@lo:400:kworker.0 Request processed in 100us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305559.005870:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788305559.005895:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788305559.005902:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015212544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305559.005939:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015212544:12345-0@lo:400:kworker.0 Request processed in 38us (1430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305559.005945:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1788305559.005970:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788305559.006034:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38a80 x1875174015212032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305559.006049:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015212032:0@lo:400:kworker.0 00010000:00080000:1.0:1788305559.006061:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c700 x1875174015212544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305559.006069:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015212544:0@lo:400:kworker.0 00000100:00100000:0.0:1788305559.006303:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015211520 00000100:00100000:0.0:1788305559.006319:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015211520 00000100:00100000:0.0:1788305559.006368:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788305559.006377:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015211520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305559.006436:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015211520:12345-0@lo:400:kworker.0 Request processed in 60us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305559.006443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788305559.006942:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015211520:0@lo:400:kworker.0 00000100:00100000:0.0:1788305559.475901:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305559.476011:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155264 00000100:00100000:1.0:1788305559.476034:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155264 00000100:00100000:1.0:1788305559.476108:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 319 00000100:00100000:1.0:1788305559.476120:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:6171:x1875173994155264:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305559.476142:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305559.476179:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08345 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305559.476216:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305559.476247:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305559.476258:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50600, rc 0) 00000100:00100000:1.0:1788305559.476615:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155264:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 495us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305559.476624:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 319 00000100:00100000:3.0:1788305559.491708:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305559.491746:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155392 00000100:00100000:3.0:1788305559.491757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155392 00000100:00100000:3.0:1788305559.491839:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 320 00000100:00100000:3.0:1788305559.491851:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155392:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305559.492071:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155392:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 220us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305559.492080:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 320 00000100:00100000:2.0:1788305559.495055:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305559.497615:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155520 00000100:00100000:3.0:1788305559.497635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155520 00000100:00100000:2.0:1788305559.497889:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 321 00000100:00100000:2.0:1788305559.497903:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155520:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305559.499446:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155520:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 1528us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305559.499463:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 321 00000100:00100000:3.0:1788305559.504749:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305559.508719:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155648 00000100:00100000:0.0:1788305559.508740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155648 00000100:00100000:0.0:1788305559.509671:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 322 00000100:00100000:0.0:1788305559.509694:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994155648:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305559.509718:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305559.509741:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0834c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305559.509888:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305559.509899:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305559.509908:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a600, rc 0) 00000100:00100000:0.0:1788305559.509982:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994155648:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 295us (5244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305559.509990:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 322 00000100:00100000:2.0:1788305559.512480:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305559.512623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155776 00000100:00100000:0.0:1788305559.512636:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155776 00000100:00100000:0.0:1788305559.512700:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 323 00000100:00100000:0.0:1788305559.512709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994155776:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305559.513216:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994155776:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 505us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305559.513226:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 323 00000100:00100000:2.0:1788305559.515528:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305559.515581:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994155904 00000100:00100000:0.0:1788305559.515593:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994155904 00000100:00100000:0.0:1788305559.515654:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 324 00000100:00100000:0.0:1788305559.515665:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994155904:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305559.515892:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994155904:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 227us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305559.515907:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 324 00010000:00010000:2.0:1788305559.644731:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788305560.149680:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305560.149691:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889082750000 from 7 10000000:01000000:2.0:1788305560.149697:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305560.149766:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.149782:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.149797:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305560.149831:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015212928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305560.149934:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305560.150098:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015212928 00000100:00100000:1.0:1788305560.150109:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015212928 00000100:00100000:1.0:1788305560.150173:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788305560.150185:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015212928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305560.150202:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305560.150221:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053601 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.150251:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053601 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.150263:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053601 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.150320:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51e00, rc 0) 00000100:00100000:1.0:1788305560.150368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015212928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.150391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788305560.152148:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305560.152205:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015212928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305560.152238:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.152252:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305560.152393:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305560.152457:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305560.152586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213056 00000100:00100000:1.0:1788305560.152594:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213056 00000100:00100000:1.0:1788305560.152650:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788305560.152660:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015213056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.152824:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015213056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.152833:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788305560.155506:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305560.155578:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305560.155664:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305560.155777:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305560.155817:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.156153:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213184 00000100:00100000:1.0:1788305560.156162:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213184 00000100:00100000:1.0:1788305560.156230:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788305560.156242:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015213184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.157457:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015213184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1209us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.157469:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788305560.157665:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305560.172181:0:13249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788305560.175161:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788305560.175219:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305560.175236:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305560.175252:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305560.175265:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305560.175269:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891b9152800 from 7 10000000:01000000:3.0:1788305560.175790:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305560.175861:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305560.175872:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305560.175885:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305560.175920:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.177136:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305560.177270:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90aca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305560.179920:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213312 00000100:00100000:2.0:1788305560.179943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213312 00000100:00100000:2.0:1788305560.181226:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788305560.181251:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015213312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305560.181299:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305560.181431:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605360f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.181472:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605360f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.181486:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605360f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.181498:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:2.0:1788305560.181621:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 381us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305560.181629:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788305560.181770:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb268380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305560.181796:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.181807:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305560.181931:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.181971:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305560.186495:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213440 00000100:00100000:3.0:1788305560.186515:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213440 00000100:00100000:3.0:1788305560.186598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788305560.186610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.186815:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (4842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305560.186824:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788305560.189512:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.189580:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.189665:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.189762:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305560.189867:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305560.194156:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213568 00000100:00100000:3.0:1788305560.194178:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213568 00000100:00100000:3.0:1788305560.194565:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1788305560.194580:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.194813:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (5050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305560.194822:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788305560.194929:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305560.197080:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788305560.197228:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788305560.197260:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305560.197297:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.197449:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305560.197465:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305560.197469:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cd800 from 7 10000000:01000000:1.0:1788305560.197473:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305560.197529:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.197538:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.197563:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305560.197598:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.197690:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305560.197988:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305560.202161:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213696 00000100:00100000:2.0:1788305560.202186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213696 00000100:00100000:2.0:1788305560.203466:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788305560.203500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015213696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305560.203529:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305560.203569:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605361d expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.203624:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.203638:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.203650:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305560.203782:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015213696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (6091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305560.203790:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788305560.204533:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305560.204572:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.204587:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305560.204703:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305560.204758:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305560.204857:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.207175:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213824 00000100:00100000:1.0:1788305560.207196:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213824 00000100:00100000:3.0:1788305560.209246:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788305560.216494:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015213824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.216805:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015213824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7543us (12045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.216819:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788305560.217175:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3a8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.217250:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.217589:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305560.217636:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.217705:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015213952 00000100:00100000:1.0:1788305560.217714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015213952 00000100:00100000:1.0:1788305560.217770:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788305560.217782:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015213952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.217902:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015213952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.217909:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788305560.219168:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015213952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305560.221580:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788305560.221849:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788305560.221882:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305560.221897:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.221911:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305560.221924:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305560.221927:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a3800 from 7 10000000:01000000:1.0:1788305560.221930:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305560.221986:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.221996:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.222097:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305560.222134:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.222230:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305560.223450:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305560.226600:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214080 00000100:00100000:2.0:1788305560.226624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214080 00000100:00100000:2.0:1788305560.226769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788305560.226783:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015214080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305560.226811:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305560.226842:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605362b expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.226895:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605362b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.226910:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605362b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305560.226923:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305560.227052:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015214080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 271us (4821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305560.227060:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788305560.227163:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305560.227186:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305560.227205:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305560.228649:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.228734:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305560.234479:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.235111:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214208 00000100:00100000:1.0:1788305560.235124:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214208 00000100:00100000:1.0:1788305560.235197:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788305560.235209:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015214208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.235578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015214208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (6842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.235587:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788305560.236158:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.236227:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305560.237152:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305560.237218:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305560.237479:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214336 00000100:00100000:1.0:1788305560.237488:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214336 00000100:00100000:1.0:1788305560.237563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788305560.237575:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015214336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305560.239168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015214336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1583us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305560.239183:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788305560.242474:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015214336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788305560.245901:0:13252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788305560.250137:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788305560.250194:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305560.250211:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305560.250227:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305560.670634:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305561.045635:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305561.045661:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015214464:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305561.045750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305561.045925:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214464 00000100:00100000:1.0:1788305561.045933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214464 00000100:00100000:1.0:1788305561.045987:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788305561.045997:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015214464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305561.046032:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305561.046089:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015214464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305561.046096:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788305561.046189:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015214464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305561.046530:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015214592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305561.046572:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305561.046641:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214592 00000100:00100000:2.0:1788305561.046646:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214592 00000100:00100000:2.0:1788305561.046677:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788305561.046684:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015214592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305561.046703:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788305561.047549:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015214592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 851us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305561.047559:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788305561.047640:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015214592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305561.202220:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305561.202328:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156032 00000100:00100000:0.0:1788305561.202340:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156032 00000100:00100000:0.0:1788305561.202387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 337 00000100:00100000:0.0:1788305561.202397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994156032:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305561.202467:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994156032:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305561.202475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 337 00000100:00100000:3.0:1788305561.220450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305561.220525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305561.228661:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305561.237567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156160 00000100:00100000:1.0:1788305561.237582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156160 00000100:00100000:1.0:1788305561.237670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156288 00000100:00100000:1.0:1788305561.237674:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156288 00000100:00100000:1.0:1788305561.237704:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:1.0:1788305561.237715:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994156160:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305561.237820:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994156160:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 107us (17434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305561.237828:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:1.0:1788305561.237847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:1.0:1788305561.237854:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994156288:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305561.237879:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994156288:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (17354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305561.237885:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:3.0:1788305561.239316:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00080000:0.0:1788305561.239399:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305561.239405:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305561.240108:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156544 00000100:00100000:1.0:1788305561.240119:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156544 00000100:00100000:1.0:1788305561.240184:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156416 00000100:00100000:1.0:1788305561.240188:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156416 00000100:00100000:1.0:1788305561.240212:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:1.0:1788305561.240238:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994156544:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305561.240329:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994156544:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 93us (11677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305561.240336:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:1.0:1788305561.240354:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:1.0:1788305561.240360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994156416:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305561.240384:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994156416:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305561.240390:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00080000:0.0:1788305561.240522:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305561.240526:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788305561.688170:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305562.579517:0:13392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305562.710696:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305563.733604:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305564.117771:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015215104:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.117840:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118150:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015215616:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118176:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118199:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015216128:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118219:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118245:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788305564.118251:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015214976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118299:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118320:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015215488:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118344:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118359:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015216000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118380:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118395:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015216512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118444:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.118479:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215104 00000100:00100000:1.0:1788305564.118486:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215104 00000100:00100000:1.0:1788305564.118537:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215616 00000100:00100000:1.0:1788305564.118541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215616 00000100:00100000:1.0:1788305564.118559:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216128 00000100:00100000:1.0:1788305564.118562:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216128 00000100:00100000:1.0:1788305564.118577:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788305564.118585:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015215104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118632:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015215104:12345-0@lo:400:kworker.0 Request processed in 47us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.118639:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788305564.118656:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788305564.118662:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015215616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118685:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015215616:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.118691:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788305564.118701:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788305564.118708:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015216128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.118729:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015216128:12345-0@lo:400:kworker.0 Request processed in 22us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.118735:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788305564.118926:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215488 00000100:00100000:0.0:1788305564.118931:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215488 00000100:00100000:0.0:1788305564.118961:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788305564.118968:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305564.119194:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015215488:12345-0@lo:400:kworker.0 Request processed in 226us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305564.119201:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788305564.119219:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305564.119411:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015214848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305564.119443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119462:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015215360:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119483:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119503:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015215872:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119550:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015216384:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119570:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119591:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788305564.119597:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015214720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305564.119616:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119629:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015215232:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119662:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015215744:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119680:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119690:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015216256:0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.119705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305564.119725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215232 00000100:00100000:2.0:1788305564.119729:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215232 00000100:00100000:0.0:1788305564.120111:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214848 00000100:00100000:0.0:1788305564.120121:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214848 00000100:00100000:0.0:1788305564.120153:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214720 00000100:00100000:0.0:1788305564.120156:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214720 00000100:00100000:0.0:1788305564.120169:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305564.120176:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015214848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305564.120199:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305564.120243:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015214848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305564.120251:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788305564.120263:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788305564.120416:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305564.120425:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015215232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120457:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015215232:12345-0@lo:400:kworker.0 Request processed in 36us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120464:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788305564.120520:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216000 00000100:00100000:2.0:1788305564.120524:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216000 00000100:00100000:2.0:1788305564.120545:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216512 00000100:00100000:2.0:1788305564.120548:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216512 00000100:00100000:2.0:1788305564.120557:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215872 00000100:00100000:2.0:1788305564.120560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215872 00000100:00100000:2.0:1788305564.120568:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216384 00000100:00100000:2.0:1788305564.120577:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216384 00000100:00100000:2.0:1788305564.120592:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305564.120598:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015216000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120627:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015216000:12345-0@lo:400:kworker.0 Request processed in 28us (2246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120632:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305564.120643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305564.120648:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015216512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120671:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015216512:12345-0@lo:400:kworker.0 Request processed in 23us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120677:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788305564.120687:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305564.120692:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015215872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120715:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015215872:12345-0@lo:400:kworker.0 Request processed in 23us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120720:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305564.120728:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305564.120734:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015216384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120770:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015216384:12345-0@lo:400:kworker.0 Request processed in 36us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120776:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305564.120792:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215360 00000100:00100000:2.0:1788305564.120795:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215360 00000100:00100000:2.0:1788305564.120808:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015215744 00000100:00100000:2.0:1788305564.120811:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015215744 00000100:00100000:2.0:1788305564.120821:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216256 00000100:00100000:2.0:1788305564.120823:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216256 00000100:00100000:2.0:1788305564.120843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788305564.120848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015215360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305564.120877:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015215360:12345-0@lo:400:kworker.0 Request processed in 29us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305564.120883:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788305564.121805:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015214720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305564.121838:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305564.121892:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015214720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1622us (2274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305564.122131:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788305564.122168:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305564.122172:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305564.122175:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305564.122184:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305564.122199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015216640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305564.122252:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305564.122337:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b4380 x1875174015214720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.122356:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015214720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305564.122369:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015215232:0@lo:400:kworker.0 00010000:00080000:0.0:1788305564.122380:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c380 x1875174015214848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.122399:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015214848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305564.122412:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015215360:0@lo:400:kworker.0 00010000:00080000:0.0:1788305564.122420:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a9500 x1875174015215872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.122426:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015215872:0@lo:400:kworker.0 00010000:00080000:0.0:1788305564.122434:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a8e00 x1875174015216384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.122440:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015216384:0@lo:400:kworker.0 00000100:00100000:0.0:1788305564.122472:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216640 00000100:00100000:0.0:1788305564.122477:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216640 00000100:00100000:0.0:1788305564.122507:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788305564.122529:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015216640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305564.122541:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305564.122571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015216640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305564.122577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:0.0:1788305564.122599:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c000 x1875174015216640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.122610:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015216640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305564.122711:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788305564.122722:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015215744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.122761:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015215744:12345-0@lo:400:kworker.0 Request processed in 42us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.122776:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788305564.122790:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788305564.122797:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015216256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305564.122826:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015216256:12345-0@lo:400:kworker.0 Request processed in 31us (3120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.122832:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788305564.123004:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015214976 00000100:00100000:3.0:1788305564.123008:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015214976 00000100:00100000:3.0:1788305564.123042:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788305564.123048:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015214976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123082:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015214976:12345-0@lo:400:kworker.0 Request processed in 34us (4783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305564.123088:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788305564.123121:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015214976:0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123134:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015215488:0@lo:400:kworker.0 00010000:00080000:3.0:1788305564.123146:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a9880 x1875174015216000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305564.123156:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015216000:0@lo:400:kworker.0 00010000:00080000:3.0:1788305564.123165:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a9c00 x1875174015216512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305564.123172:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015216512:0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123183:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015215104:0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123194:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015215616:0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123205:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015216128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305564.123844:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015216768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305564.123882:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305564.124107:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216768 00000100:00100000:1.0:1788305564.124111:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216768 00000100:00100000:1.0:1788305564.124151:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788305564.124160:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015216768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305564.124174:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305564.124217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015216768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305564.124224:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:3.0:1788305564.124402:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890833bf100 x1875174015216768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305564.124418:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015216768:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788305564.124502:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aa300 x1875174015215744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.124522:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015215744:0@lo:400:kworker.0 00010000:00080000:0.0:1788305564.124543:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837aa680 x1875174015216256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305564.124552:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015216256:0@lo:400:kworker.0 00010000:00010000:1.0:1788305564.760769:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305565.781585:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305566.165598:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305566.170759:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015217024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305566.170863:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305566.178208:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217024 00000100:00100000:2.0:1788305566.178232:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217024 00000100:00100000:2.0:1788305566.178342:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788305566.178356:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015217024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305566.178408:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305566.178807:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015217024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 452us (7942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305566.178816:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788305566.178864:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015216896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305566.178941:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305566.179548:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015217024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305566.179723:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015216896 00000100:00100000:0.0:1788305566.179731:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015216896 00000100:00100000:0.0:1788305566.179786:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788305566.179796:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015216896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305566.179830:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788305566.179889:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015216896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305566.179896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788305566.180174:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015216896:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305566.319946:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305566.320051:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305566.320079:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305566.320100:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305566.320410:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305566.320450:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156928 00000100:00100000:1.0:1788305566.320464:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156928 00000100:00100000:1.0:1788305566.320551:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157184 00000100:00100000:1.0:1788305566.320555:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157184 00000100:00100000:1.0:1788305566.320572:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156800 00000100:00100000:1.0:1788305566.320574:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156800 00000100:00100000:1.0:1788305566.320585:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157056 00000100:00100000:1.0:1788305566.320606:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157056 00000100:00100000:1.0:1788305566.320629:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:1.0:1788305566.320641:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994156928:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305566.320741:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994156928:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 101us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305566.320749:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:1.0:1788305566.320771:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 222 00000100:00100000:1.0:1788305566.320778:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994157184:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305566.320804:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994157184:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305566.320810:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 222 00000100:00100000:1.0:1788305566.320822:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:1.0:1788305566.320828:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994156800:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305566.320852:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994156800:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305566.320857:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:1.0:1788305566.320868:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00100000:1.0:1788305566.320874:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994157056:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305566.320895:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994157056:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305566.320901:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00080000:1.0:1788305566.320938:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305566.320943:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305566.321986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994156672 00000100:00100000:3.0:1788305566.321998:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994156672 00000100:00100000:3.0:1788305566.322061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 339 00000100:00100000:3.0:1788305566.322071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994156672:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305566.322215:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994156672:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 146us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305566.322223:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 339 00010000:00010000:1.0:1788305566.805607:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305567.829432:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305568.589959:0:13540:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:32:46 (1788305566) === 00000100:00100000:2.0:1788305568.832014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305568.832075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157312 00000100:00100000:2.0:1788305568.832077:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305568.832086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157312 00000100:00080000:2.0:1788305568.832126:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305568.832167:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788305568.832179:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994157312:12345-192.168.202.55@tcp:41:mkdir.0 00000004:00000024:1.0:1788305568.832220:0:6521:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305568.832226:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157440 00000100:00100000:3.0:1788305568.832232:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157440 00000100:00100000:3.0:1788305568.832266:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:3.0:1788305568.832308:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10499:x1875173994157440:12345-192.168.202.55@tcp:700:mkdir.0 00000100:00100000:3.0:1788305568.832356:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10499:x1875173994157440:12345-192.168.202.55@tcp:700:mkdir.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305568.832356:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994157312:12345-192.168.202.55@tcp:41:mkdir.0 Request processed in 174us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305568.832372:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:1.0:1788305568.832376:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:1.0:1788305568.847105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305568.847174:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157696 00000100:00100000:2.0:1788305568.847185:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157696 00000100:00100000:2.0:1788305568.847269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:2.0:1788305568.847430:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:10499:x1875173994157696:12345-192.168.202.55@tcp:36:mkdir.0 00010000:00010000:2.0:1788305568.847500:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305568.847582:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60534db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c0 expref: 6 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847600:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9700) 00010000:00010000:2.0:1788305568.847611:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305568.847721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847736:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847745:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847761:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847768:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.847775:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848794:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848811:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848820:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305568.848838:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da323623 reply state 000000004dd88d20 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848848:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848864:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:3.0:1788305568.848866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305568.848870:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788305568.848874:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305568.848881:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848887:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848894:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848899:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305568.848904:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848912:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848921:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9500) 00010000:00010000:3.0:1788305568.848923:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305568.848927:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848933:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053639 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305568.848949:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da323623 reply state 000000004dd88d20 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848968:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.848975:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8891833f9300) 00010000:00010000:3.0:1788305568.848977:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305568.848979:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788305568.849077:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10499:x1875173994157696:12345-192.168.202.55@tcp:36:mkdir.0 Request processed in 1647us (1981us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788305568.849085:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00010000:00010000:2.0:1788305568.857896:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305568.870433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305568.870601:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994157824 00000100:00100000:2.0:1788305568.870614:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994157824 00000100:00100000:2.0:1788305568.870690:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788305568.870704:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10500:x1875173994157824:12345-192.168.202.55@tcp:101:chmod.0 00010000:00010000:2.0:1788305568.870751:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305568.870784:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e605364e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08353 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.870881:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.870899:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.870915:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305568.872597:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305568.872611:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305568.872689:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.872741:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e605364e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08353 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.872766:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08353 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305568.872777:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9700) 00010000:00010000:2.0:1788305568.872781:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305568.872786:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305568.872896:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:10500:x1875173994157824:12345-192.168.202.55@tcp:101:chmod.0 Request processed in 2193us (2597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305568.872908:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788305568.895368:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305568.895950:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158080 00000100:00100000:1.0:1788305568.895964:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158080 00000100:00100000:1.0:1788305568.896036:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788305568.896051:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:10500:x1875173994158080:12345-192.168.202.55@tcp:36:chmod.0 00010000:00010000:1.0:1788305568.896118:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305568.896154:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053655 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08353 expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.896180:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9700) 00010000:00010000:1.0:1788305568.896192:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305568.896218:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.896232:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.896243:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305568.896503:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc52740e reply state 0000000053c4aa91 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.896518:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.896523:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:1.0:1788305568.896526:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788305568.896529:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788305568.896536:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788305568.897775:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:10500:x1875173994158080:12345-192.168.202.55@tcp:36:chmod.0 Request processed in 591us (1279us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788305568.897788:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305568.946492:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305568.946777:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158208 00000100:00100000:1.0:1788305568.946795:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158208 00000100:00100000:1.0:1788305568.946865:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305568.946880:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:10501:x1875173994158208:12345-192.168.202.55@tcp:101:chown.0 00010000:00010000:1.0:1788305568.946906:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305568.946929:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053663 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0835a expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947003:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947018:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947033:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305568.947101:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305568.947106:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305568.947145:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947172:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053663 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0835a expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947189:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0835a expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305568.947198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:1.0:1788305568.947201:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305568.947205:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50a00, rc 0) 00000100:00100000:1.0:1788305568.947309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:10501:x1875173994158208:12345-192.168.202.55@tcp:101:chown.0 Request processed in 432us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305568.947317:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305568.956726:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305568.956871:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158336 00000100:00100000:3.0:1788305568.956882:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158336 00000100:00100000:3.0:1788305568.956948:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:3.0:1788305568.956959:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:10501:x1875173994158336:12345-192.168.202.55@tcp:101:chown.0 00010000:00010000:3.0:1788305568.956980:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305568.957003:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08361 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957427:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957444:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957456:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957483:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957505:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957513:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957601:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957610:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957617:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305568.957734:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305568.957739:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305568.957761:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957773:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957779:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957786:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957792:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305568.957796:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957809:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957822:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:3.0:1788305568.957826:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305568.957830:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957835:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957848:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957854:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957860:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957866:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305568.957869:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957875:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957881:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8891833f9300) 00010000:00010000:3.0:1788305568.957884:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305568.957887:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957903:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605367f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957936:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08361 expref: 12 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957950:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08361 expref: 11 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.957958:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:3.0:1788305568.957961:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305568.957963:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305568.958036:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10501:x1875173994158336:12345-192.168.202.55@tcp:101:chown.0 Request processed in 1078us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305568.958044:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788305568.965240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305568.971431:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158464 00000100:00100000:0.0:1788305568.971451:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158464 00000100:00100000:0.0:1788305568.971544:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305568.971557:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10501:x1875173994158464:12345-192.168.202.55@tcp:900:chown.0 00000100:00100000:0.0:1788305568.971666:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10501:x1875173994158464:12345-192.168.202.55@tcp:900:chown.0 Request processed in 111us (6445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305568.971674:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788305568.992772:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305568.994359:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158720 00000100:00100000:3.0:1788305568.994374:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158720 00000100:00100000:3.0:1788305568.994451:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:3.0:1788305568.994462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10501:x1875173994158720:12345-192.168.202.55@tcp:36:chown.0 00010000:00010000:3.0:1788305568.994529:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305568.994559:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08361 expref: 11 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.994581:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:3.0:1788305568.994586:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305568.994625:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.994650:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305568.994662:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305569.001123:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:3.0:1788305569.001193:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071d62de1 reply state 000000007dd58688 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001216:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001224:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:3.0:1788305569.001227:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788305569.001231:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788305569.001245:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:3.0:1788305569.001364:0:6520:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788305569.001380:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:10501:x1875173994158720:12345-192.168.202.55@tcp:36:chown.0 Request processed in 6915us (8618us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788305569.001389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00010000:00010000:3.0:1788305569.001456:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001474:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001482:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001502:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305569.001508:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001516:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001527:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:3.0:1788305569.001530:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305569.001534:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.001540:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605368d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001809:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001817:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001824:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001830:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305569.001843:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001850:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001860:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8891833f9300) 00010000:00010000:1.0:1788305569.001863:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305569.001867:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001874:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6053640 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001894:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001900:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001907:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001911:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305569.001914:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001920:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001927:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8890825b2800) 00010000:00010000:1.0:1788305569.001931:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305569.001941:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001947:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053647 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001963:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001969:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001974:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001979:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305569.001982:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001987:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.001995:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:1.0:1788305569.001998:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788305569.002001:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.002006:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e605365c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305569.022633:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305569.022781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994158848 00000100:00100000:0.0:1788305569.022799:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994158848 00000100:00100000:0.0:1788305569.022951:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:0.0:1788305569.022966:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:10502:x1875173994158848:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:0.0:1788305569.023002:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305569.023035:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08368 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305569.028173:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5047us 00010000:00010000:0.0:1788305569.056394:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056437:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056452:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056457:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056461:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056645:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056651:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056656:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305569.056688:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305569.056692:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305569.056731:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056752:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056756:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056762:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056766:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305569.056770:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056775:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056786:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:0.0:1788305569.056788:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305569.056792:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056795:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605369b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056804:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056808:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056811:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056819:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305569.056821:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056825:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056829:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88908337b800) 00010000:00010000:0.0:1788305569.056830:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305569.056831:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056835:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60536a2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056872:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08368 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056882:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08368 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.056888:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:0.0:1788305569.056890:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788305569.056891:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b800, rc 0) 00000100:00100000:0.0:1788305569.056979:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10502:x1875173994158848:12345-192.168.202.55@tcp:101:touch.500 Request processed in 34017us (34358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305569.056986:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788305569.060085:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305569.060753:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994159104 00000100:00100000:1.0:1788305569.060789:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994159104 00000100:00100000:1.0:1788305569.060923:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788305569.060938:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10502:x1875173994159104:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:1.0:1788305569.060968:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305569.060998:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536b0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0836f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061177:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061199:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061215:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061589:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061616:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.061636:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305569.063924:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788305569.064348:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60536c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064371:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60536c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064385:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60536c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064438:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064447:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064455:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064462:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305569.064480:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064489:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064504:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:0.0:1788305569.064508:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305569.064514:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064521:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e60536b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305569.064628:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc3afe29 reply state 0000000075887c29 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064644:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064652:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff8891885c8100) 00010000:00010000:0.0:1788305569.064654:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305569.064658:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305569.064710:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536b0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0836f expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064729:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60536c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0836f expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.064737:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88908337bb00) 00010000:00010000:0.0:1788305569.064740:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305569.064742:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ba00, rc 0) 00000100:00100000:0.0:1788305569.064832:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:10502:x1875173994159104:12345-192.168.202.55@tcp:101:touch.500 Request processed in 3896us (4758us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788305569.064842:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305569.068774:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.068902:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994159360 00000100:00100000:3.0:1788305569.068919:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994159360 00000100:00100000:3.0:1788305569.069028:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:3.0:1788305569.069042:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:10502:x1875173994159360:12345-192.168.202.55@tcp:36:touch.500 00010000:00010000:3.0:1788305569.069126:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305569.069164:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60536c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0836f expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.069190:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff88908337bb00) 00010000:00010000:3.0:1788305569.069206:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305569.069416:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.069432:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.069462:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305569.069894:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b8c558b reply state 000000004f3c041a transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.069910:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.069918:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:1.0:1788305569.069928:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305569.069932:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305569.070121:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10502:x1875173994159360:12345-192.168.202.55@tcp:36:touch.500 Request processed in 1081us (1363us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788305569.070130:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305569.074570:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.074731:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994159488 00000100:00100000:3.0:1788305569.074743:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994159488 00000100:00100000:3.0:1788305569.074804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788305569.074813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:10502:x1875173994159488:12345-192.168.202.55@tcp:101:touch.500 00010000:00010000:3.0:1788305569.074841:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305569.074865:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60536da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08376 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.074929:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60536da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08376 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.074942:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60536da lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08376 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.074958:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:3.0:1788305569.074961:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305569.074964:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305569.075054:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:10502:x1875173994159488:12345-192.168.202.55@tcp:101:touch.500 Request processed in 241us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.075062:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:2.0:1788305569.082014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305569.082094:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994159616 00000100:00100000:1.0:1788305569.082108:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994159616 00000100:00100000:1.0:1788305569.082173:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788305569.082185:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875173994159616:12345-192.168.202.55@tcp:8:touch.500 00010000:00080000:1.0:1788305569.082231:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:1.0:1788305569.082266:0:8435:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e60536e1 00002000:00100000:1.0:1788305569.082310:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891/ffff8891bfa68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305569.082335:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305569.082442:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305569.082490:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8891bfa6a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305569.082627:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994159616:12345-192.168.202.55@tcp:8:touch.500 Request processed in 443us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.082634:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788305569.094985:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.095648:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994159744 00000100:00100000:3.0:1788305569.095663:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994159744 00000100:00100000:3.0:1788305569.095769:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788305569.095782:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:0:x1875173994159744:12345-192.168.202.55@tcp:2:touch.500 00000100:00080000:2.0:1788305569.096166:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788305569.103173:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:3.0:1788305569.103198:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000100:00100000:2.0:1788305569.112754:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:0:x1875173994159744:12345-192.168.202.55@tcp:2:touch.500 Request processed in 16957us (17768us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788305569.112772:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305569.118504:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305569.118629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994160000 00000100:00100000:0.0:1788305569.118643:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994160000 00000100:00100000:0.0:1788305569.118727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:0.0:1788305569.118741:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:10502:x1875173994160000:12345-192.168.202.55@tcp:35:touch.500 00000100:00100000:0.0:1788305569.119633:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:10502:x1875173994160000:12345-192.168.202.55@tcp:35:touch.500 Request processed in 887us (1140us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788305569.119666:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:0.0:1788305569.161522:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305569.162169:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994160128 00000100:00100000:1.0:1788305569.162183:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994160128 00000100:00100000:1.0:1788305569.164215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788305569.164244:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:10503:x1875173994160128:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:1.0:1788305569.164317:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305569.164352:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60536e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0837d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164529:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305569.164591:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305569.164596:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305569.164648:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164684:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60536e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0837d expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164709:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0837d expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.164719:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:1.0:1788305569.164723:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305569.164727:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51800, rc 0) 00000100:00100000:1.0:1788305569.164830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:10503:x1875173994160128:12345-192.168.202.55@tcp:101:rm.0 Request processed in 601us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.164839:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788305569.175609:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.178217:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994160384 00000100:00100000:3.0:1788305569.178447:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994160384 00000100:00100000:2.0:1788305569.182526:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:2.0:1788305569.182546:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:10503:x1875173994160384:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:2.0:1788305569.182575:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305569.182607:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e60536f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08384 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305569.182749:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788305569.182940:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e60536f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08384 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.182960:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:2.0:1788305569.182963:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305569.182969:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e60536f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08384 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.182987:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea200, rc 0) 00000100:00100000:2.0:1788305569.184700:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:10503:x1875173994160384:12345-192.168.202.55@tcp:101:rm.0 Request processed in 2141us (9090us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788305569.184743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:1.0:1788305569.193126:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305569.200878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994160512 00000100:00100000:0.0:1788305569.200899:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994160512 00000100:00100000:0.0:1788305569.201060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:0.0:1788305569.201075:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:10503:x1875173994160512:12345-192.168.202.55@tcp:37:rm.0 00000100:00100000:1.0:1788305569.210609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:10503:x1875173994160512:12345-192.168.202.55@tcp:37:rm.0 Request processed in 9520us (17482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.210647:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788305569.216873:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305569.217164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994160768 00000100:00100000:2.0:1788305569.217179:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994160768 00000100:00100000:2.0:1788305569.217270:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305569.217319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:10503:x1875173994160768:12345-192.168.202.55@tcp:35:rm.0 00000100:00100000:2.0:1788305569.217659:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:10503:x1875173994160768:12345-192.168.202.55@tcp:35:rm.0 Request processed in 343us (800us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788305569.217678:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788305569.225482:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.230432:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994161024 00000100:00100000:3.0:1788305569.230458:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994161024 00000100:00100000:3.0:1788305569.230581:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788305569.230597:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:10503:x1875173994161024:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:3.0:1788305569.230634:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305569.230663:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053704 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0838b expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.230836:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605370b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.230856:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605370b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.230869:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605370b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305569.230882:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305569.231032:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053704 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0838b expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.231055:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605370b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0838b expref: 18 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.231065:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:3.0:1788305569.231087:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305569.231092:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305569.231184:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161024:12345-192.168.202.55@tcp:101:rm.0 Request processed in 590us (5730us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788305569.231193:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:2.0:1788305569.237863:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305569.237898:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015217152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305569.238008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.238812:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305569.238863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305569.238938:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015217536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305569.238966:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305569.238982:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217152 00000100:00100000:1.0:1788305569.238992:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217152 00000100:00100000:1.0:1788305569.239067:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217280 00000100:00100000:1.0:1788305569.239071:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217280 00000100:00100000:1.0:1788305569.239092:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305569.239104:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015217152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305569.239137:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305569.239201:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015217152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.239210:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788305569.239236:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305569.239243:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015217280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305569.239254:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305569.239957:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015217792:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.240003:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.247714:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015217408:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.247841:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.247926:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015217920:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.247962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.247985:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015218432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.248012:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.248037:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305569.248044:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015218304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.248069:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.248115:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015217664:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.248143:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.248165:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015218176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.248188:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.248202:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305569.248208:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015218048:0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.248405:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015217280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9158us (9537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.248419:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788305569.248519:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305569.248624:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217920 00000100:00100000:1.0:1788305569.248634:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217920 00000100:00100000:1.0:1788305569.248682:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218432 00000100:00100000:1.0:1788305569.248686:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218432 00000100:00100000:1.0:1788305569.248713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218304 00000100:00100000:1.0:1788305569.248716:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218304 00000100:00100000:1.0:1788305569.248729:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217664 00000100:00100000:1.0:1788305569.248731:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217664 00000100:00100000:1.0:1788305569.248741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218176 00000100:00100000:1.0:1788305569.248762:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218176 00000100:00100000:1.0:1788305569.248785:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788305569.248798:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015217920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.248872:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015217920:12345-0@lo:400:kworker.0 Request processed in 76us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.248879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788305569.248899:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788305569.248906:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015218432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.248934:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015218432:12345-0@lo:400:kworker.0 Request processed in 29us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.248939:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788305569.248950:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788305569.248956:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015218304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.248987:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015218304:12345-0@lo:400:kworker.0 Request processed in 31us (916us total) trans 0 rc 0/0 00010000:00080000:2.0:1788305569.248994:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890833bea00 x1875174015217152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305569.249001:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788305569.249016:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788305569.249024:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015217664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.249073:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015217664:12345-0@lo:400:kworker.0 Request processed in 50us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.249080:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788305569.249092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788305569.249098:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015218176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.249125:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015218176:12345-0@lo:400:kworker.0 Request processed in 27us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.249140:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:1.0:1788305569.249161:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305569.249164:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305569.249173:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217536 00000100:00100000:1.0:1788305569.249177:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217536 00000100:00080000:1.0:1788305569.249194:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305569.249210:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788305569.249364:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015217152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305569.249376:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305569.249396:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015218560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305569.249437:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015217664:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249451:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015218176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249491:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015218688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249527:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.249643:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217792 00000100:00100000:3.0:1788305569.249649:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217792 00000100:00100000:3.0:1788305569.249684:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218048 00000100:00100000:3.0:1788305569.249687:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218048 00000100:00100000:3.0:1788305569.249702:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788305569.249708:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015217792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249747:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015217792:12345-0@lo:400:kworker.0 Request processed in 40us (9744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.249753:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788305569.249766:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788305569.249772:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015218048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249821:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015218048:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.249828:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788305569.249845:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305569.249865:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015218048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.249944:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.249963:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218688 00000100:00100000:3.0:1788305569.249967:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218688 00000100:00100000:0.0:1788305569.249990:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015217408 00000100:00100000:0.0:1788305569.249999:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015217408 00000100:00100000:3.0:1788305569.250011:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994161152 00000100:00100000:3.0:1788305569.250017:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994161152 00000100:00100000:3.0:1788305569.250037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788305569.250043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015218688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.250095:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015218688:12345-0@lo:400:kworker.0 Request processed in 52us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.250102:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788305569.250115:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:3.0:1788305569.250123:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161152:12345-192.168.202.55@tcp:41:rm.0 00000004:00000024:3.0:1788305569.250191:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788305569.250337:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015217536:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788305569.250360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:1.0:1788305569.250387:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305569.250507:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161152:12345-192.168.202.55@tcp:41:rm.0 Request processed in 383us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.250515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00010000:00080000:3.0:1788305569.250633:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083db5c00 x1875174015218688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305569.250647:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015218688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.250811:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015217536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1593us (11841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.250822:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788305569.250829:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218560 00000100:00100000:2.0:1788305569.250839:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218560 00000100:00080000:1.0:1788305569.250901:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305569.250917:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788305569.250928:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015218560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305569.250942:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305569.250983:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015218560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.250990:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305569.251022:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00010000:00080000:3.0:1788305569.251067:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837eb100 x1875174015217536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305569.251088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015217536:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1788305569.251111:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890833bf800 x1875174015218560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305569.251122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015218560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305569.251151:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015217408:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788305569.251433:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38700 x1875174015217280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305569.251450:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015217408:12345-0@lo:400:kworker.0 Request processed in 303us (3609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305569.251456:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015217280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305569.251475:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788305569.251503:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015218816:0@lo:400:kworker.0 00010000:00080000:0.0:1788305569.251598:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083db4e00 x1875174015218304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305569.251614:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015218304:0@lo:400:kworker.0 00000100:00100000:1.0:1788305569.251832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305569.251933:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015217792:0@lo:400:kworker.0 00000100:00100000:0.0:1788305569.251987:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015217920:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.252004:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218816 00000100:00100000:3.0:1788305569.252012:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218816 00000100:00100000:0.0:1788305569.252023:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015218432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305569.252044:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015217408:0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.252112:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305569.252124:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015218816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305569.252175:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015218816:12345-0@lo:400:kworker.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.252191:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1788305569.252255:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083db7480 x1875174015218816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305585 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305569.252266:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015218816:0@lo:400:kworker.0 00000100:00100000:0.0:1788305569.259031:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305569.259207:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994161280 00000100:00100000:3.0:1788305569.259230:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994161280 00000100:00100000:3.0:1788305569.259340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:3.0:1788305569.259352:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161280:12345-192.168.202.55@tcp:101:rm.0 00010000:00010000:3.0:1788305569.259377:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305569.259613:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053719 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08392 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259707:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259738:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259753:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259761:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259767:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259887:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259896:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.259920:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305569.259966:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788305569.259972:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305569.259995:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261700:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261721:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261729:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261737:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261744:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305569.261749:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261757:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261777:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:3.0:1788305569.261782:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305569.261788:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053720 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261844:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261850:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261856:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261862:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305569.261865:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261872:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261882:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff8891885c8100) 00010000:00010000:3.0:1788305569.261885:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305569.261888:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261895:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053727 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261949:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053719 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08392 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261967:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08392 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305569.261982:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:3.0:1788305569.261985:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305569.261988:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565200, rc 0) 00000100:00100000:3.0:1788305569.262442:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:10503:x1875173994161280:12345-192.168.202.55@tcp:101:rm.0 Request processed in 3089us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305569.262454:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:0.0:1788305569.266646:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305569.267130:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994161536 00000100:00100000:1.0:1788305569.267144:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994161536 00000100:00100000:1.0:1788305569.267231:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:1.0:1788305569.267245:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:10503:x1875173994161536:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:1.0:1788305569.267361:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788305569.267400:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e605372e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08392 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267425:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60536da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08376 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267440:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:1.0:1788305569.267451:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51800/0x4a426866e60536ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0837d expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267459:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:1.0:1788305569.267474:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305569.267591:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267608:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267620:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267647:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267655:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267662:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267832:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267842:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.267850:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305569.268731:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788305569.268749:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399359472907ns, next at 400359468805ns, rc = 0 00010000:00010000:1.0:1788305569.268841:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.268856:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.268866:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.268874:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.268891:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.268898:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269163:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305569.269196:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269204:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269210:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269217:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305569.269223:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269231:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269246:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:1.0:1788305569.269249:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788305569.269253:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269260:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51600/0x4a426866e6053743 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269311:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269324:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269330:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269335:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305569.269338:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269344:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269351:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:1.0:1788305569.269354:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305569.269358:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269363:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51400/0x4a426866e6053735 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305569.269376:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008857f52b reply state 000000003b000a2c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269389:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305569.269395:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff8891885c8100) 00010000:00010000:1.0:1788305569.269398:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305569.269401:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788305569.269714:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305569.269723:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.269730:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305569.269742:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.269748:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.269758:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:2.0:1788305569.269760:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788305569.269763:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.269768:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e605374a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305569.269779:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305569.269780:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305569.269782:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305569.269905:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161536:12345-192.168.202.55@tcp:36:rm.0 Request processed in 2657us (3271us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788305569.269921:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:0.0:1788305569.283840:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305569.284055:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994161792 00000100:00100000:2.0:1788305569.284070:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994161792 00000100:00100000:2.0:1788305569.284159:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788305569.284173:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994161792:12345-192.168.202.55@tcp:35:rm.0 00000100:00100000:3.0:1788305569.285617:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:10503:x1875173994161792:12345-192.168.202.55@tcp:35:rm.0 Request processed in 1433us (1778us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788305569.285634:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788305569.291254:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305569.291530:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162048 00000100:00100000:0.0:1788305569.291556:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162048 00000100:00100000:0.0:1788305569.291634:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788305569.291647:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:10503:x1875173994162048:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:0.0:1788305569.291727:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788305569.291765:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605370b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0838b expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291793:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60536a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08368 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291805:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337bc00) 00010000:00010000:0.0:1788305569.291825:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50a00/0x4a426866e605366a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0835a expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291835:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891bb166b00) 00010000:00010000:0.0:1788305569.291843:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305569.291876:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291892:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291903:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291918:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291950:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.291958:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292065:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292074:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292081:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305569.292452:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788305569.292486:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292494:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292502:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292509:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305569.292514:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292522:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292545:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff88908337b800) 00010000:00010000:0.0:1788305569.292548:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788305569.292552:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292560:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b000/0x4a426866e605375f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292580:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292586:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292592:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292598:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305569.292601:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292608:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292615:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88908337bf00) 00010000:00010000:0.0:1788305569.292618:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305569.292621:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292626:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053751 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305569.292650:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002388a42e reply state 00000000331e7059 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292662:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305569.292668:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88908337bb00) 00010000:00010000:0.0:1788305569.292670:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305569.292673:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305569.292784:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:10503:x1875173994162048:12345-192.168.202.55@tcp:36:rm.0 Request processed in 1138us (1543us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788305569.292793:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00010000:00010000:1.0:1788305569.877549:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305570.903234:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305571.285829:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305571.285861:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015218944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305571.285962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305571.286057:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305571.286066:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015219072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305571.286096:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305571.286138:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015218944 00000100:00100000:3.0:1788305571.286148:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015218944 00000100:00100000:3.0:1788305571.286206:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219072 00000100:00100000:3.0:1788305571.286209:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219072 00000100:00100000:3.0:1788305571.286231:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788305571.286241:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015218944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305571.286319:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305571.286376:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015218944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305571.286385:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788305571.286438:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788305571.286455:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015219072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305571.286477:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305571.286515:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015219072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305571.286521:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788305571.286579:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015219072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305571.286612:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015218944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305571.454348:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454400:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454424:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454450:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454479:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454508:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305571.454554:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162432 00000100:00100000:0.0:1788305571.454569:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162432 00000100:00100000:0.0:1788305571.454644:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162688 00000100:00100000:0.0:1788305571.454647:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162688 00000100:00100000:0.0:1788305571.454665:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162304 00000100:00100000:0.0:1788305571.454667:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162304 00000100:00100000:0.0:1788305571.454679:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162816 00000100:00100000:0.0:1788305571.454681:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162816 00000100:00100000:0.0:1788305571.454698:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:0.0:1788305571.454708:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994162432:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305571.454827:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994162432:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 118us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305571.454836:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:0.0:1788305571.454858:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:0.0:1788305571.454865:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994162688:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305571.454890:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994162688:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305571.454896:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:0.0:1788305571.454907:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:0.0:1788305571.454913:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2397:x1875173994162304:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305571.454940:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2397:x1875173994162304:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305571.454946:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:0.0:1788305571.454957:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:0.0:1788305571.454963:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994162816:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305571.454984:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994162816:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305571.454991:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:0.0:1788305571.455011:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162560 00000100:00100000:0.0:1788305571.455014:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162560 00000100:00100000:0.0:1788305571.455049:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788305571.455056:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994162560:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305571.455083:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994162560:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305571.455096:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:1.0:1788305571.458313:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162176 00000100:00100000:1.0:1788305571.458335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162176 00000100:00100000:1.0:1788305571.458419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 341 00000100:00100000:1.0:1788305571.458433:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994162176:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305571.458544:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994162176:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 114us (4209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305571.458553:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 341 00000100:00080000:1.0:1788305571.458605:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305571.458613:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305571.458617:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788305571.927078:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305572.961094:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305573.974312:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305574.357888:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015219200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305574.357967:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305574.360025:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219200 00000100:00100000:1.0:1788305574.360042:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219200 00000100:00100000:1.0:1788305574.360142:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788305574.360159:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015219200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305574.360266:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305574.360407:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015219200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 253us (2438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.360429:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788305574.360487:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015219328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305574.360536:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305574.360584:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305574.360866:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219328 00000100:00100000:2.0:1788305574.360878:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219328 00000100:00100000:2.0:1788305574.360951:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788305574.360961:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015219328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305574.360985:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305574.361074:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015219328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305574.361081:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1788305574.361106:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788305574.361141:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837ead80 x1875174015219200/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305574.361168:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015219200:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788305574.361200:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890833bdf80 x1875174015219328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305574.361242:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015219328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305574.361262:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305574.361270:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015219456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305574.361343:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.361400:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219456 00000100:00100000:2.0:1788305574.361407:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219456 00000100:00100000:2.0:1788305574.361473:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788305574.361481:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015219456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305574.361501:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305574.361548:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015219456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305574.361554:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1788305574.361590:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837e8a80 x1875174015219456/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305574.361605:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015219456:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305574.361744:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788305574.362064:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404452786854ns, next at 405452782602ns, rc = 0 00000100:00100000:2.0:1788305574.362086:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015219584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305574.362134:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.362176:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219584 00000100:00100000:2.0:1788305574.362180:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219584 00000100:00100000:2.0:1788305574.362220:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788305574.362229:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015219584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305574.362242:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305574.362308:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015219584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305574.362316:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:2.0:1788305574.362330:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305574.362349:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083db5c00 x1875174015219584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305574.362364:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015219584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305574.362745:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015220096:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.362777:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015219840:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.362785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.362818:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015220608:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.362819:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305574.362840:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015220352:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.362859:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305574.362891:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015219968:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.362900:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305574.362911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015219712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.362918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305574.362938:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015220480:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.362951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305574.362960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.362996:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015220224:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.363018:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219968 00000100:00100000:3.0:1788305574.363022:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219968 00000100:00100000:2.0:1788305574.363028:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305574.363052:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220224 00000100:00100000:2.0:1788305574.363053:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015220736:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.363055:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220224 00000100:00100000:3.0:1788305574.363069:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788305574.363076:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015219968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.363084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.363115:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219712 00000100:00100000:2.0:1788305574.363120:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219712 00000100:00100000:3.0:1788305574.363133:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015219968:12345-0@lo:400:kworker.0 Request processed in 55us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305574.363140:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788305574.363159:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788305574.363169:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015219712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.363171:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788305574.363182:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015220224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.363227:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015219712:12345-0@lo:400:kworker.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305574.363232:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015220224:12345-0@lo:400:kworker.0 Request processed in 51us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305574.363242:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1788305574.363243:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788305574.363297:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015219968:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.363329:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305574.363334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015219712:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.363354:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015220224:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.363364:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220096 00000100:00100000:1.0:1788305574.363457:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015219840 00000100:00100000:1.0:1788305574.363462:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015219840 00000100:00100000:1.0:1788305574.363489:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220608 00000100:00100000:1.0:1788305574.363491:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220608 00000100:00100000:1.0:1788305574.363522:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220480 00000100:00100000:1.0:1788305574.363526:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220480 00000100:00100000:1.0:1788305574.363539:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220736 00000100:00100000:1.0:1788305574.363541:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220736 00000100:00100000:1.0:1788305574.363553:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220352 00000100:00100000:1.0:1788305574.363556:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220352 00000100:00100000:1.0:1788305574.363570:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788305574.363576:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015219840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363620:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015219840:12345-0@lo:400:kworker.0 Request processed in 43us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.363627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788305574.363642:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788305574.363649:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015220608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363681:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015220608:12345-0@lo:400:kworker.0 Request processed in 33us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.363687:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788305574.363698:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788305574.363705:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015220480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363749:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015220480:12345-0@lo:400:kworker.0 Request processed in 44us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.363756:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788305574.363768:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788305574.363774:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015220736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363798:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015220736:12345-0@lo:400:kworker.0 Request processed in 25us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.363804:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788305574.363815:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788305574.363821:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015220352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363846:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015220352:12345-0@lo:400:kworker.0 Request processed in 25us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305574.363852:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00080000:1.0:1788305574.363886:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa55880 x1875174015220480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305574.363898:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015220480:0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363932:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015219840:0@lo:400:kworker.0 00000100:00100000:1.0:1788305574.363942:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015220352:0@lo:400:kworker.0 00000100:00080000:2.0:1788305574.364007:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305574.364012:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788305574.364029:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa56a00 x1875174015220736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305574.364038:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015220736:0@lo:400:kworker.0 00000100:00100000:2.0:1788305574.364048:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015220608:0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.366829:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220096 00000100:00100000:3.0:1788305574.366899:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788305574.366910:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015220096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305574.366990:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015220096:12345-0@lo:400:kworker.0 Request processed in 83us (4209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305574.367005:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788305574.368515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015220096:0@lo:400:kworker.0 00000004:00080000:3.0:1788305574.373456:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788305574.373516:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788305574.373528:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788305574.374058:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374070:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374075:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374079:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305574.374083:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374089:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374103:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff8891885c8100) 00010000:00010000:0.0:1788305574.374106:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305574.374108:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374112:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60536be lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374130:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374136:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374157:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374163:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305574.374165:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374171:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374193:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8890825b2f00) 00010000:00010000:0.0:1788305574.374195:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305574.374197:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374201:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60536d3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374217:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374220:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374224:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374228:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305574.374229:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374241:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374246:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x79255cc3 (ffff8891885c8100) 00010000:00010000:0.0:1788305574.374247:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305574.374249:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374252:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e605373c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x79255cc3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305574.374490:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305574.374507:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015220864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788305574.374581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305574.374641:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374648:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374654:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374659:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305574.374663:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374670:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374679:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff88908337bb00) 00010000:00010000:0.0:1788305574.374682:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305574.374685:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.374698:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053758 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305574.374866:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220864 00000100:00100000:2.0:1788305574.374875:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220864 00000100:00100000:2.0:1788305574.375011:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305574.375020:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015220864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788305574.375044:0:8437:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788305574.375071:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9760a0, atime: 0x6a9760a0, ctime: 0x6a9760a0, blocks: 0x0 00010000:00010000:2.0:1788305574.375077:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305574.375088:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1788305574.375092:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305574.375098:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305574.375115:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305574.375135:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305574.375143:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305574.375164:0:8437:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788305574.375331:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015220864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 312us (749us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788305574.375336:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788305574.375396:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305574.375404:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.375412:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305574.375426:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305574.375633:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891bb357b80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788305574.375639:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015220864:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788305574.375972:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.375992:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.376000:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053766 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305574.376019:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305574.376021:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305574.376023:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305574.548929:0:13688:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788305574.997712:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788305575.688056:0:13736:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1c30f0f0 20000000:00000080:2.0:1788305575.688077:0:13736:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff88908316f000 uarg=0000000000000000 20000000:01000000:2.0:1788305575.688147:0:13736:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788305575.688720:0:13736:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788305575.688727:0:13736:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788305575.689555:0:13737:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788305575.690690:0:13736:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788305575.698086:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788305575.698140:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788305575.698170:0:13736:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788305575.698191:0:13736:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305575.698218:0:13736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698243:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698263:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698269:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053601 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698310:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605360f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698318:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698326:0:13736:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605362b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698335:0:13736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698394:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605362b expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698421:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605362b expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698440:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015220992:0@lo:104: 00000100:00100000:2.0:1788305575.698552:0:13736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305575.698627:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698645:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698655:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221120:0@lo:104: 00010000:00010000:2.0:1788305575.698697:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605360f expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698705:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605360f expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698714:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221248:0@lo:104: 00010000:00010000:2.0:1788305575.698742:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698749:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 23 pid: 6513 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698757:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221376:0@lo:104: 00000100:00100000:0.0:1788305575.698768:0:6503:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788305575.698783:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305575.698788:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305575.698794:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698804:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221504:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305575.698865:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015220992 00000100:00100000:1.0:1788305575.698874:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015220992 00010000:00010000:2.0:1788305575.698877:0:13736:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.698896:0:13736:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.698905:0:13736:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221632:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305575.698921:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015221120 00000100:00100000:1.0:1788305575.698925:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015221120 00000100:00100000:1.0:1788305575.699223:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305575.699241:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+4:13736:x1875174015220992:12345-0@lo:104: 00010000:00010000:1.0:1788305575.699256:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305575.699591:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305575.699619:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305575.699628:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788305575.699636:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788305575.699716:0:13736:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305575.701388:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015221248 00000100:00100000:2.0:1788305575.701412:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015221248 00000100:00100000:2.0:1788305575.701472:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788305575.701482:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015221376 00000100:00100000:2.0:1788305575.701486:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015221376 00000100:00100000:0.0:1788305575.701832:0:13738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788305575.701846:0:13738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+6:13736:x1875174015221120:12345-0@lo:104: 00010000:00010000:0.0:1788305575.701866:0:13738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702000:0:13738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305575.702007:0:13738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+6:13736:x1875174015221120:12345-0@lo:104: Request processed in 164us (3218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.702016:0:13738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788305575.702044:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305575.702051:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702059:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305575.702065:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702075:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305575.702083:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305575.702089:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305575.702218:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702225:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305575.702462:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702469:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e605361d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053624 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702552:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305575.702555:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305575.702557:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305575.702575:0:13738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305575.702585:0:13738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+5:13736:x1875174015221248:12345-0@lo:104: 00010000:00010000:0.0:1788305575.702597:0:13738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702648:0:13738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305575.702653:0:13738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+5:13736:x1875174015221248:12345-0@lo:104: Request processed in 71us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.702659:0:13738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:0.0:1788305575.702675:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305575.702679:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702686:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305575.702689:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702696:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305575.702702:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305575.702716:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788305575.702750:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702758:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305575.702783:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702791:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605360f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053616 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702802:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305575.702804:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305575.702806:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305575.702818:0:13738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788305575.702825:0:13738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+4:13736:x1875174015221376:12345-0@lo:104: 00010000:00010000:0.0:1788305575.702833:0:13738:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.702877:0:13738:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788305575.702883:0:13738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:137eb269-2484-4047-a131-a502494b009f+4:13736:x1875174015221376:12345-0@lo:104: Request processed in 59us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.702890:0:13738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305575.703188:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305575.703208:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015221888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305575.703261:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305575.703350:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015221888 00000100:00100000:3.0:1788305575.703356:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015221888 00010000:00010000:3.0:1788305575.703388:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605360f expref: 24 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305575.703447:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305575.703455:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015221888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305575.703469:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305575.703487:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605360f expref: 24 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305575.703501:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605360f expref: 24 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305575.703524:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305575.703554:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015221888:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305575.703561:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305575.703605:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015221888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305575.704674:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015221760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305575.704744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305575.704855:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221120:0@lo:104: 00010000:00010000:2.0:1788305575.704869:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053616 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605360f expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.704886:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221248:0@lo:104: 00000100:00100000:2.0:1788305575.704896:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221376:0@lo:104: 00000100:00100000:2.0:1788305575.704909:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221504:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305575.705267:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015221760 00000100:00100000:0.0:1788305575.705304:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015221760 00010000:00010000:0.0:1788305575.705343:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305575.705380:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305575.705420:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+23:3650:x1875174015221760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305575.705441:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305575.705448:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.705460:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.705556:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb000/0x4a426866e6053624 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605361d expref: 23 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.705573:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305575.705643:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:137eb269-2484-4047-a131-a502494b009f+22:3650:x1875174015221760:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.705652:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305575.705750:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015221760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305575.705935:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305575.705946:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.705955:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305575.705961:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.705971:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305575.705979:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305575.705985:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305575.706025:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706032:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788305575.706092:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015222016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305575.706300:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305575.706385:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222016 00000100:00100000:0.0:1788305575.706391:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222016 00010000:00010000:0.0:1788305575.706427:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 22 pid: 6513 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305575.706454:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305575.706462:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+22:3648:x1875174015222016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305575.706471:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305575.706485:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 22 pid: 6513 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.706495:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 22 pid: 6513 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.706508:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51e00/0x4a426866e6053608 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6053601 expref: 22 pid: 6513 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.706535:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305575.706711:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706719:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb400/0x4a426866e6053601 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053608 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706734:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305575.706744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305575.706746:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305575.706841:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305575.706849:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:137eb269-2484-4047-a131-a502494b009f+3:13736:x1875174015220992:12345-0@lo:104: Request processed in 7610us (8298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305575.706860:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788305575.706908:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305575.706914:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706921:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305575.706924:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706933:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305575.706941:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305575.706947:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305575.706972:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.706980:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305575.706996:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.707003:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c50200/0x4a426866e605362b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6053632 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305575.707028:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305575.707029:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305575.707031:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305575.707047:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015222144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305575.707078:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305575.707203:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083643800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015220992:0@lo:104: 00000100:00100000:0.0:1788305575.707944:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+21:3648:x1875174015222016:12345-0@lo:103:ldlm_bl.0 Request processed in 1477us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.707954:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305575.707980:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222144 00000100:00100000:0.0:1788305575.707985:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222144 00010000:00010000:0.0:1788305575.708015:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605362b expref: 21 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305575.708049:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305575.708058:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+21:3649:x1875174015222144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305575.708071:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305575.708077:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605362b expref: 21 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.708091:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605362b expref: 21 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.708120:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb600/0x4a426866e6053632 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605362b expref: 21 pid: 6514 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305575.708137:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305575.708425:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+20:3649:x1875174015222144:12345-0@lo:103:ldlm_bl.0 Request processed in 366us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305575.708433:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305575.708532:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015222144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305575.708671:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015222016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305575.713430:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305575.713546:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994162944 00000100:00100000:2.0:1788305575.713560:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994162944 00010000:00010000:2.0:1788305575.713612:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.713658:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788305575.713688:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994162944:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305575.713730:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305575.713739:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.713754:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.713778:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a600/0x4a426866e60535fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0834c expref: 13 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.713801:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305575.713877:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:2396:x1875173994162944:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 192us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305575.713886:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788305575.716685:0:13736:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13736:1875174015221632:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305575.716766:0:13736:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305575.718016:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305575.718340:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163072 00000100:00100000:2.0:1788305575.718350:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163072 00010000:00010000:2.0:1788305575.718414:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305575.718463:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:2.0:1788305575.718487:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:2395:x1875173994163072:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305575.718508:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305575.718515:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718551:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718575:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50600/0x4a426866e60535f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08345 expref: 12 pid: 6512 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718599:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718608:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718627:0:6506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718635:0:6506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718642:0:6506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718649:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718655:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305575.718660:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718668:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718706:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305575.718720:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305575.718790:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994163072:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 316us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305575.718799:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00010000:00010000:3.0:1788305575.718964:0:13736:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305575.718975:0:13736:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305575.718982:0:13736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ea400/0x4a426866e605376d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13736 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305576.023092:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305576.406464:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015222272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305576.407702:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015222400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305576.407777:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305576.408612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305576.408677:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222272 00000100:00100000:3.0:1788305576.408688:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222272 00000100:00100000:3.0:1788305576.408747:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222400 00000100:00100000:3.0:1788305576.408750:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222400 00000100:00100000:3.0:1788305576.408769:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788305576.408780:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015222272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305576.408824:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305576.409081:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788305576.409093:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015222400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305576.409115:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788305576.409184:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015222400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305576.409193:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788305576.410750:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015222272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1964us (3242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.410765:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788305576.410859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015222400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305576.410925:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015222272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305576.561371:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305576.561435:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305576.561467:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305576.561467:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163200 00000100:00100000:1.0:1788305576.561479:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163200 00000100:00100000:3.0:1788305576.561488:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305576.561509:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305576.561540:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305576.561562:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163456 00000100:00100000:1.0:1788305576.561563:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 343 00000100:00100000:3.0:1788305576.561565:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163456 00000100:00100000:1.0:1788305576.561575:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994163200:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305576.561604:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163712 00000100:00100000:3.0:1788305576.561607:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163712 00000100:00100000:3.0:1788305576.561618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163328 00000100:00100000:3.0:1788305576.561628:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163328 00000100:00100000:3.0:1788305576.561644:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163840 00000100:00100000:3.0:1788305576.561646:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163840 00000100:00100000:3.0:1788305576.561661:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 241 00000100:00100000:3.0:1788305576.561667:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163456:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305576.561675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:2395:x1875173994163200:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305576.561682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 343 00000100:00100000:3.0:1788305576.561703:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163456:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.561709:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 241 00000100:00100000:3.0:1788305576.561722:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 242 00000100:00100000:3.0:1788305576.561728:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994163712:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305576.561730:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 243 00000100:00100000:1.0:1788305576.561737:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163328:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305576.561750:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994163712:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.561756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 242 00000100:00100000:3.0:1788305576.561768:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 244 00000100:00100000:1.0:1788305576.561768:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163328:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.561773:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994163840:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305576.561775:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 243 00000100:00100000:3.0:1788305576.561795:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994163840:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.561800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 244 00000100:00100000:3.0:1788305576.561821:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163584 00000100:00100000:3.0:1788305576.561824:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163584 00000100:00100000:3.0:1788305576.561855:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788305576.561862:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163584:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305576.561905:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994163584:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 44us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305576.561922:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00080000:3.0:1788305576.561947:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305576.561964:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305576.561966:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:0.0:1788305576.836475:0:13787:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffdb31b760 20000000:00000080:0.0:1788305576.836505:0:13787:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff889083c84800 uarg=0000000000000000 20000000:01000000:0.0:1788305576.836581:0:13787:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788305576.836589:0:13787:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788305576.836595:0:13787:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:0.0:1788305576.841741:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788305576.842727:0:13787:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788305576.843068:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788305576.843110:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788305576.843126:0:13787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788305576.843146:0:13787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305576.843176:0:13787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843197:0:13787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843211:0:13787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843219:0:13787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843227:0:13787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843235:0:13787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843242:0:13787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305576.843259:0:13787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843268:0:13787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843308:0:13787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843319:0:13787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305576.843325:0:13787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3ebe00/0x4a426866e6053774 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.049859:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305577.133930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305577.136304:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994163968 00000100:00100000:0.0:1788305577.136323:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994163968 00000100:00100000:0.0:1788305577.136424:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 344 00000100:00100000:0.0:1788305577.136437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+11:6171:x1875173994163968:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305577.136470:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305577.136498:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523b000/0x4a426866e605377b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08399 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.136534:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523b000/0x4a426866e605377b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08399 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.136547:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523b000/0x4a426866e605377b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08399 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.136558:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b000, rc 0) 00000100:00100000:0.0:1788305577.136647:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994163968:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 205us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.136655:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 344 00000100:00100000:1.0:1788305577.145859:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305577.146070:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164096 00000100:00100000:2.0:1788305577.146089:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164096 00000100:00100000:2.0:1788305577.146180:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 345 00000100:00100000:2.0:1788305577.146193:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994164096:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.146647:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994164096:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 450us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.146664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 345 00000100:00100000:3.0:1788305577.163998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305577.164445:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164224 00000100:00100000:2.0:1788305577.164617:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164224 00000100:00100000:2.0:1788305577.164708:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 346 00000100:00100000:2.0:1788305577.164722:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994164224:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.165023:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994164224:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 302us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305577.165033:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 346 00000100:00100000:1.0:1788305577.172764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305577.173196:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164352 00000100:00100000:3.0:1788305577.173207:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164352 00000100:00100000:3.0:1788305577.173269:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 347 00000100:00100000:3.0:1788305577.173321:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:10788:x1875173994164352:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305577.173487:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:10788:x1875173994164352:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 168us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.173495:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 347 00000100:00100000:1.0:1788305577.178434:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305577.178549:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164480 00000100:00100000:2.0:1788305577.178558:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164480 00000100:00100000:2.0:1788305577.178617:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 348 00000100:00100000:2.0:1788305577.178643:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:10788:x1875173994164480:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305577.178795:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:10788:x1875173994164480:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 154us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305577.178803:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 348 00000100:00100000:1.0:1788305577.186367:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305577.186470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164608 00000100:00100000:0.0:1788305577.186480:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164608 00000100:00100000:0.0:1788305577.186545:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 349 00000100:00100000:0.0:1788305577.186557:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:6171:x1875173994164608:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305577.186576:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305577.186596:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891a523a600/0x4a426866e6053782 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083a0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.186646:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891a523a600/0x4a426866e6053782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a0 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.186659:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891a523a600/0x4a426866e6053782 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a0 expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.186669:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a600, rc 0) 00000100:00100000:0.0:1788305577.186734:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994164608:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 178us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.186742:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 349 00000100:00100000:1.0:1788305577.207717:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305577.207804:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164736 00000100:00100000:3.0:1788305577.207815:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164736 00000100:00100000:3.0:1788305577.207883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 350 00000100:00100000:3.0:1788305577.207894:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994164736:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.208064:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994164736:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 171us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.208073:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 350 00000100:00100000:1.0:1788305577.215934:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305577.216313:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164864 00000100:00100000:2.0:1788305577.216325:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164864 00000100:00100000:2.0:1788305577.216400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 351 00000100:00100000:2.0:1788305577.216411:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994164864:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.216578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:6171:x1875173994164864:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 168us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305577.216586:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 351 00000100:00100000:1.0:1788305577.219998:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305577.220645:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994164992 00000100:00100000:2.0:1788305577.220655:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994164992 00000100:00100000:2.0:1788305577.220718:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 352 00000100:00100000:2.0:1788305577.220728:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:10791:x1875173994164992:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788305577.220927:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:10791:x1875173994164992:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 199us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305577.220936:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 352 00000100:00100000:2.0:1788305577.236334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305577.236503:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165120 00000100:00100000:0.0:1788305577.236513:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165120 00000100:00100000:0.0:1788305577.236563:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 353 00000100:00100000:0.0:1788305577.236573:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:10791:x1875173994165120:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305577.236736:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:10791:x1875173994165120:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 163us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.236744:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 353 10000000:01000000:2.0:1788305577.493556:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305577.493565:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889082750000 from 7 10000000:01000000:2.0:1788305577.493570:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305577.493628:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305577.493641:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305577.493667:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305577.493693:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.493760:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.493833:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.494051:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222528 00000100:00100000:1.0:1788305577.494059:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222528 00000100:00100000:1.0:1788305577.494117:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788305577.494127:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+20:6516:x1875174015222528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305577.494140:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305577.494162:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51800/0x4a426866e6053790 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053789 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.494185:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51800/0x4a426866e6053790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053789 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.494195:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51800/0x4a426866e6053790 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053789 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.494204:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51800, rc 0) 00000100:00100000:1.0:1788305577.494425:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015222528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 299us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.494443:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788305577.494580:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305577.494596:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305577.494604:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305577.494663:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.494692:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.494723:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.496312:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222656 00000100:00100000:1.0:1788305577.496324:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222656 00000100:00100000:1.0:1788305577.496384:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788305577.496404:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015222656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.496568:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015222656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.496576:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788305577.496787:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.496832:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.496885:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.496918:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837689c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.498055:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222784 00000100:00100000:1.0:1788305577.498064:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222784 00000100:00100000:1.0:1788305577.498120:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788305577.498130:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015222784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.498499:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015222784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.498507:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788305577.505287:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015222784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.513325:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13800:1875174015222912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305577.513430:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305577.513545:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.517501:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015222912 00000100:00100000:0.0:1788305577.517520:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015222912 00000100:00100000:0.0:1788305577.517595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788305577.517605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:13800:x1875174015222912:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.517938:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+21:13800:x1875174015222912:12345-0@lo:502:llog_process_th.0 Request processed in 324us (4498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.517947:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788305577.523442:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13800:1875174015222912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305577.523498:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305577.523512:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.523514:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305577.523523:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889082750000 00000020:00000080:2.0:1788305577.523538:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788305577.523596:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305577.523600:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.523601:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305577.523605:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305577.523608:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.523609:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788305577.523613:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889082750000 00000020:00000080:2.0:1788305577.523615:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788305577.523664:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13800:1875174015223040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305577.523734:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.523937:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.540967:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223040 00000100:00100000:1.0:1788305577.540984:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223040 00000100:00100000:1.0:1788305577.541053:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788305577.541063:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:13800:x1875174015223040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305577.541301:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+21:13800:x1875174015223040:12345-0@lo:502:llog_process_th.0 Request processed in 238us (17566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.541309:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788305577.541601:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13800:1875174015223040:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305577.541650:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305577.541658:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305577.541661:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788305577.541665:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788305577.541919:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788305577.541949:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305577.541960:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.541971:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305577.541981:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305577.541983:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891b9152800 from 7 10000000:01000000:1.0:1788305577.541985:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305577.542014:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.542023:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.542032:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305577.542052:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.542092:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305577.542130:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305577.542493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223168 00000100:00100000:3.0:1788305577.542500:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223168 00000100:00100000:3.0:1788305577.542534:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788305577.542543:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+21:6516:x1875174015223168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305577.542554:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305577.542566:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564800/0x4a426866e605379e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6053797 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.542588:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564800/0x4a426866e605379e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6053797 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.542598:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564800/0x4a426866e605379e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6053797 expref: 22 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.542606:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564800, rc 0) 00000100:00100000:3.0:1788305577.542642:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891a50ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.542649:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788305577.544325:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305577.544350:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.544362:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305577.544464:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.544519:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305577.544559:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.544579:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223296 00000100:00100000:1.0:1788305577.544585:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223296 00000100:00100000:1.0:1788305577.544625:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788305577.544634:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.544744:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.544752:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788305577.549098:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.549330:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.549419:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305577.549456:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.550262:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223424 00000100:00100000:1.0:1788305577.550270:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223424 00000100:00100000:1.0:1788305577.550352:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788305577.550362:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.550502:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.550510:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788305577.550925:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.556812:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13803:1875174015223552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.556908:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305577.556961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223552 00000100:00100000:0.0:1788305577.556968:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223552 00000100:00100000:0.0:1788305577.557015:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788305577.557024:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:13803:x1875174015223552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.557140:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+22:13803:x1875174015223552:12345-0@lo:502:llog_process_th.0 Request processed in 117us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.557159:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788305577.557212:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.557231:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13803:1875174015223552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305577.557256:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305577.557267:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305577.557270:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305577.557308:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891b9152800 00000020:00000080:0.0:1788305577.557310:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305577.557367:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305577.557675:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305577.557678:0:13803:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305577.557682:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305577.557686:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305577.557687:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788305577.557696:0:13803:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891b9152800 00000020:00000080:0.0:1788305577.557698:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788305577.557916:0:13803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13803:1875174015223680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.557959:0:13803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305577.557985:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223680 00000100:00100000:0.0:1788305577.557990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223680 00000100:00100000:0.0:1788305577.558018:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788305577.558025:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:13803:x1875174015223680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.558101:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:13803:x1875174015223680:12345-0@lo:502:llog_process_th.0 Request processed in 75us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.558108:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788305577.558146:0:13803:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.558162:0:13803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13803:1875174015223680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305577.558180:0:13803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305577.558184:0:13803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305577.558186:0:13803:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788305577.558190:0:13803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000040:00080000:0.0:1788305577.565693:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1788305577.565828:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788305577.565855:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305577.565867:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.565880:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305577.565890:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305577.565907:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cd800 from 7 10000000:01000000:1.0:1788305577.565910:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305577.565950:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.565959:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.565970:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305577.565995:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305577.566063:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305577.566103:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.566185:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223808 00000100:00100000:1.0:1788305577.566192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223808 00000100:00100000:1.0:1788305577.566240:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788305577.566250:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+22:6516:x1875174015223808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305577.566265:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305577.569941:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50a00/0x4a426866e60537ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60537a5 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.569988:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50a00/0x4a426866e60537ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60537a5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.570003:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50a00/0x4a426866e60537ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60537a5 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305577.570013:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50a00, rc 0) 00000100:00100000:1.0:1788305577.570106:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015223808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3856us (4041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.570126:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788305577.570208:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305577.570228:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305577.570240:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305577.570354:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.570404:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.570434:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768900 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.578582:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015223936 00000100:00100000:0.0:1788305577.578597:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015223936 00000100:00100000:0.0:1788305577.578661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788305577.578672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015223936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.578915:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015223936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (8510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.578924:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788305577.579031:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015223936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.579232:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305577.579312:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.579349:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768900 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.579747:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224064 00000100:00100000:0.0:1788305577.579753:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224064 00000100:00100000:0.0:1788305577.579881:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788305577.579890:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015224064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.581243:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015224064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1348us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.581254:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788305577.581929:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.583718:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13806:1875174015224192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.583917:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305577.583968:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305577.584030:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224192 00000100:00100000:3.0:1788305577.584037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224192 00000100:00100000:3.0:1788305577.584091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788305577.584102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:13806:x1875174015224192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305577.584242:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+23:13806:x1875174015224192:12345-0@lo:502:llog_process_th.0 Request processed in 141us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.584269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788305577.584938:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13806:1875174015224192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305577.584974:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305577.584985:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.584987:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305577.584998:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891894cd800 00000020:00000080:2.0:1788305577.585001:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788305577.585068:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305577.585072:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.585073:0:13806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305577.585881:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305577.585890:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.585892:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788305577.585897:0:13806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891894cd800 00000020:00000080:2.0:1788305577.585899:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788305577.585982:0:13806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13806:1875174015224320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305577.586050:0:13806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305577.587666:0:13806:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.591896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224320 00000100:00100000:0.0:1788305577.591914:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224320 00000100:00100000:0.0:1788305577.592183:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788305577.592195:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:13806:x1875174015224320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305577.592378:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+23:13806:x1875174015224320:12345-0@lo:502:llog_process_th.0 Request processed in 184us (6326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.592397:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000040:00080000:2.0:1788305577.592654:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788305577.592817:0:13806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13806:1875174015224320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305577.592850:0:13806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305577.592858:0:13806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305577.592860:0:13806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788305577.592865:0:13806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788305577.593442:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788305577.593467:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305577.593478:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593490:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305577.593501:0:6516:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788305577.593504:0:6516:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a3800 from 7 10000000:01000000:3.0:1788305577.593507:0:6516:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305577.593558:0:6516:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593567:0:6516:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593576:0:6516:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305577.593598:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.593645:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305577.593681:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305577.593699:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224448 00000100:00100000:3.0:1788305577.593704:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224448 00000100:00100000:3.0:1788305577.593758:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788305577.593767:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+23:6516:x1875174015224448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305577.593779:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305577.593799:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565e00/0x4a426866e60537ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60537b3 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593822:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565e00/0x4a426866e60537ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60537b3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593833:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565e00/0x4a426866e60537ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60537b3 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593842:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565e00, rc 0) 00000100:00100000:3.0:1788305577.593882:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a732050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015224448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.593888:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788305577.593928:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305577.593941:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305577.593950:0:6516:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305577.593996:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.594022:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305577.594048:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.594216:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224576 00000100:00100000:0.0:1788305577.594220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224576 00000100:00100000:0.0:1788305577.594333:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788305577.594341:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015224576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.594460:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015224576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.594467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788305577.594619:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.594646:0:6516:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.594682:0:6516:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305577.594807:0:6516:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b8f89b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305577.594850:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224704 00000100:00100000:0.0:1788305577.594855:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224704 00000100:00100000:0.0:1788305577.594920:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788305577.594928:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015224704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305577.595013:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a733c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:6516:x1875174015224704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305577.595020:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788305577.595216:0:6516:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:137eb269-2484-4047-a131-a502494b009f:6516:1875174015224704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305577.595486:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13808:1875174015224832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305577.595523:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305577.595547:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224832 00000100:00100000:3.0:1788305577.595550:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224832 00000100:00100000:3.0:1788305577.595592:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788305577.595600:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:13808:x1875174015224832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305577.595678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:13808:x1875174015224832:12345-0@lo:502:llog_process_th.0 Request processed in 78us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305577.595685:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788305577.595724:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305577.595881:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13808:1875174015224832:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305577.595909:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305577.595919:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305577.595922:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305577.595929:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88918c9a3800 00000020:00000080:3.0:1788305577.595932:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305577.596037:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305577.596042:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305577.596044:0:13808:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305577.596047:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305577.596050:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305577.596052:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788305577.596056:0:13808:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88918c9a3800 00000020:00000080:3.0:1788305577.596059:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788305577.597234:0:13808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13808:1875174015224960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305577.597375:0:13808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305577.597440:0:13808:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305577.597724:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015224960 00000100:00100000:1.0:1788305577.597731:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015224960 00000100:00100000:1.0:1788305577.597794:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788305577.597805:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:13808:x1875174015224960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305577.597939:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:13808:x1875174015224960:12345-0@lo:502:llog_process_th.0 Request processed in 124us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305577.597948:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788305577.597968:0:13808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:137eb269-2484-4047-a131-a502494b009f:13808:1875174015224960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788305577.597997:0:13808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305577.598005:0:13808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305577.598007:0:13808:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788305577.598011:0:13808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788305577.598197:0:6516:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788305577.598217:0:6516:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305577.598228:0:6516:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305577.598238:0:6516:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305578.069554:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305578.581976:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788305578.647163:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305579.093588:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305579.477802:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015225216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305579.477893:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305579.478135:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225216 00000100:00100000:2.0:1788305579.478143:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225216 00000100:00100000:2.0:1788305579.478210:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788305579.478222:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015225216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305579.478272:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305579.478344:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015225216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305579.478352:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788305579.478416:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015225216:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305579.478479:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305579.479130:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015225088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305579.479171:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305579.479213:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015225344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305579.479240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.479746:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015225472:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.480705:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481235:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015225984:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481315:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015226496:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481382:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788305579.481390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015225600:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481432:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015226112:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015226624:0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305579.481540:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225984 00000100:00100000:1.0:1788305579.481547:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225984 00000100:00100000:1.0:1788305579.481592:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788305579.481613:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015225984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.481671:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015225984:12345-0@lo:400:kworker.0 Request processed in 70us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305579.481679:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788305579.481703:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226496 00000100:00100000:1.0:1788305579.481707:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226496 00000100:00100000:3.0:1788305579.482067:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015225856:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.482102:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305579.482117:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015226368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.482140:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305579.482163:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788305579.482169:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015225728:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.482191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305579.482207:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015226240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.482227:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305579.482246:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226368 00000100:00100000:3.0:1788305579.482250:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226368 00000100:00100000:2.0:1788305579.482316:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225088 00000100:00100000:2.0:1788305579.482321:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225088 00000100:00100000:0.0:1788305579.482431:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225472 00000100:00100000:0.0:1788305579.482436:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225472 00000100:00100000:0.0:1788305579.482469:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788305579.482476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015225472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305579.482515:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a731450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015225472:12345-0@lo:400:kworker.0 Request processed in 39us (1813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305579.482522:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788305579.482583:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015226752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305579.482607:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305579.482647:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225600 00000100:00100000:0.0:1788305579.482652:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225600 00000100:00100000:0.0:1788305579.482670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226112 00000100:00100000:0.0:1788305579.482673:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226112 00000100:00100000:1.0:1788305579.482750:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226624 00000100:00100000:1.0:1788305579.482754:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226624 00000100:00100000:3.0:1788305579.482843:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305579.482851:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015226368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.482886:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015226368:12345-0@lo:400:kworker.0 Request processed in 37us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.482893:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788305579.482924:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225728 00000100:00100000:3.0:1788305579.482928:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225728 00000100:00100000:3.0:1788305579.482950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305579.482969:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015225728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015225728:12345-0@lo:400:kworker.0 Request processed in 36us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483011:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305579.483122:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015225728:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483134:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015226368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483194:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225344 00000100:00100000:3.0:1788305579.483198:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225344 00000100:00100000:3.0:1788305579.483218:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226752 00000100:00100000:3.0:1788305579.483221:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226752 00000100:00100000:3.0:1788305579.483232:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305579.483238:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015225344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305579.483291:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305579.483330:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015225344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (4089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483337:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305579.483348:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788305579.483354:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015226752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305579.483363:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305579.483408:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015226752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483413:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788305579.483440:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015226752:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788305579.483477:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836bd500 x1875174015225344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305579.483491:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015225344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305579.483515:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015225856 00000100:00100000:3.0:1788305579.483519:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015225856 00000100:00100000:3.0:1788305579.483535:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226240 00000100:00100000:3.0:1788305579.483537:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226240 00000100:00100000:3.0:1788305579.483552:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788305579.483560:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015225600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483593:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015225600:12345-0@lo:400:kworker.0 Request processed in 35us (2181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483600:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788305579.483612:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788305579.483617:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015226496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483643:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015226496:12345-0@lo:400:kworker.0 Request processed in 26us (2300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483648:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788305579.483661:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788305579.483667:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015225856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483695:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015225856:12345-0@lo:400:kworker.0 Request processed in 30us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483701:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788305579.483712:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788305579.483718:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015226240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483746:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015226240:12345-0@lo:400:kworker.0 Request processed in 27us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305579.483759:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00010000:00080000:3.0:1788305579.483799:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa36d80 x1875174015226240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305579.483810:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015226240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483823:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015225856:0@lo:400:kworker.0 00000100:00080000:3.0:1788305579.483877:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305579.483883:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305579.483885:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305579.483887:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305579.483906:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015225600:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483918:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015225472:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015225984:0@lo:400:kworker.0 00000100:00100000:3.0:1788305579.483940:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015226496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305579.485402:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788305579.485419:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015225088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305579.485444:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305579.485515:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015225088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (6344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305579.485523:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788305579.485571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890833bf100 x1875174015225088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305579.485589:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890833bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015225088:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788305579.485758:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305579.486141:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788305579.486150:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015226112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305579.486216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015226112:12345-0@lo:400:kworker.0 Request processed in 67us (4763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305579.486222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1788305579.486255:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015226112:0@lo:400:kworker.0 00000100:00080000:3.0:1788305579.486345:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305579.496296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788305579.496316:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015226624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305579.496432:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015226624:12345-0@lo:400:kworker.0 Request processed in 124us (14926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305579.496440:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:1.0:1788305579.496499:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa35c00 x1875174015226624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305579.496515:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015226624:0@lo:400:kworker.0 00000100:00080000:3.0:1788305579.496637:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1788305579.992401:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1788305580.119336:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305581.142948:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305581.525538:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305581.525565:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015226880:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305581.525653:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305581.525742:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015226880 00000100:00100000:3.0:1788305581.525751:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015226880 00000100:00100000:3.0:1788305581.525803:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788305581.525813:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015226880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305581.525850:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305581.526191:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015226880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 377us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305581.526199:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788305581.526247:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015226880:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305581.529679:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305581.529711:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015227008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305581.529804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305581.533245:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227008 00000100:00100000:3.0:1788305581.533262:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227008 00000100:00100000:3.0:1788305581.533393:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788305581.533405:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015227008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305581.533444:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305581.533543:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015227008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (3738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305581.533551:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788305581.533603:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015227008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305581.678339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305581.678380:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305581.678409:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165376 00000100:00100000:3.0:1788305581.678413:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305581.678419:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165376 00000100:00100000:3.0:1788305581.678436:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305581.678451:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305581.678466:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305581.678472:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165888 00000100:00100000:0.0:1788305581.678475:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165888 00000100:00080000:3.0:1788305581.678479:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305581.678482:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305581.678487:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165504 00000100:00100000:0.0:1788305581.678490:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165504 00000100:00080000:3.0:1788305581.678502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305581.678507:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165760 00000100:00100000:0.0:1788305581.678509:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165760 00000100:00100000:3.0:1788305581.678529:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 251 00000100:00100000:3.0:1788305581.678540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165376:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305581.678577:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165632 00000100:00100000:1.0:1788305581.678581:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165632 00000100:00100000:3.0:1788305581.678610:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165376:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305581.678611:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:1.0:1788305581.678618:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165632:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305581.678652:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165632:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305581.678671:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:1.0:1788305581.678693:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994165248 00000100:00100000:1.0:1788305581.678696:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994165248 00000100:00100000:1.0:1788305581.678718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 375 00000100:00100000:1.0:1788305581.678724:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994165248:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305581.678750:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a730850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994165248:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305581.678757:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 375 00000100:00100000:0.0:1788305581.683602:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 252 00000100:00100000:0.0:1788305581.683627:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994165888:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305581.684123:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994165888:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 506us (5705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305581.684132:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 252 00000100:00100000:0.0:1788305581.684154:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 253 00000100:00100000:0.0:1788305581.684161:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165504:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305581.684213:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994165504:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 52us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305581.684219:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 253 00000100:00100000:0.0:1788305581.684231:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 254 00000100:00100000:0.0:1788305581.684238:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994165760:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305581.684272:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994165760:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (5804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305581.684295:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 254 00000100:00080000:0.0:1788305581.684367:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305581.684373:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305581.684691:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 251 00010000:00010000:0.0:1788305582.165577:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305583.190516:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305584.214033:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305584.597672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305584.597707:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015227136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305584.597793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305584.598139:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227136 00000100:00100000:2.0:1788305584.598147:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227136 00000100:00100000:2.0:1788305584.598211:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788305584.598222:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015227136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305584.598251:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305584.598348:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015227136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305584.598356:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1788305584.598433:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305584.598469:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015227136:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305584.598784:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015227264:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305584.598823:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305584.598860:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305584.598866:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015227392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305584.598900:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305584.598927:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227264 00000100:00100000:3.0:1788305584.598932:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227264 00000100:00100000:3.0:1788305584.598958:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227392 00000100:00100000:3.0:1788305584.598961:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227392 00000100:00100000:3.0:1788305584.598978:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305584.598984:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015227264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305584.599001:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305584.599109:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788305584.599119:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015227392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305584.599130:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305584.599166:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015227392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305584.599173:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788305584.599203:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305584.599206:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305584.599266:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015227264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 282us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305584.599273:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788305584.599636:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788305584.599641:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891bb357b80, transno 4294967301 00000100:00100000:3.0:1788305584.599711:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015227392:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788305584.599726:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837a9880 x1875174015227264/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305584.599740:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015227264:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305584.600234:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015227520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305584.600269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305584.600320:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227520 00000100:00100000:1.0:1788305584.600336:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227520 00000100:00100000:1.0:1788305584.600374:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788305584.600381:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015227520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305584.600394:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305584.600428:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015227520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.600435:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788305584.600453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788305584.600469:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa35180 x1875174015227520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305584.600481:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015227520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305584.601475:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015227776:0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.601513:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305584.601537:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015228288:0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.601579:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305584.601616:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305584.601622:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015227904:0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.601647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305584.601664:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015228416:0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.601682:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305584.601779:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015228032:0@lo:400:kworker.0 00000100:00100000:0.0:1788305584.604500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305584.611369:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015228544:0@lo:400:kworker.0 00000100:00100000:0.0:1788305584.611438:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305584.611523:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227776 00000100:00100000:1.0:1788305584.611532:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227776 00000100:00100000:1.0:1788305584.611569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228288 00000100:00100000:1.0:1788305584.611572:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228288 00000100:00100000:1.0:1788305584.611622:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228416 00000100:00100000:1.0:1788305584.611626:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228416 00000100:00100000:1.0:1788305584.611641:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228032 00000100:00100000:1.0:1788305584.611644:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228032 00000100:00100000:1.0:1788305584.611662:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788305584.611670:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015228288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.611735:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015228288:12345-0@lo:400:kworker.0 Request processed in 65us (10155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.611743:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788305584.611778:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788305584.611785:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015228416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.611815:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015228416:12345-0@lo:400:kworker.0 Request processed in 32us (10132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.611822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788305584.611833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788305584.611840:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015228032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.611870:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015228032:12345-0@lo:400:kworker.0 Request processed in 31us (7378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.611875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:1.0:1788305584.612782:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305584.612789:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305584.612836:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788305584.612845:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015227776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.612941:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015227776:12345-0@lo:400:kworker.0 Request processed in 97us (11427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.612948:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788305584.612999:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015227648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.626670:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305584.626745:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015228160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.626779:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305584.626810:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015228672:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627068:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227904 00000100:00100000:1.0:1788305584.627076:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227904 00000100:00100000:1.0:1788305584.627124:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228160 00000100:00100000:1.0:1788305584.627127:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228160 00000100:00100000:1.0:1788305584.627145:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788305584.627154:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015227904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627212:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015227904:12345-0@lo:400:kworker.0 Request processed in 58us (25563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.627219:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788305584.627238:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788305584.627245:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015228160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627297:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015228160:12345-0@lo:400:kworker.0 Request processed in 33us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.627304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788305584.627381:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015227904:0@lo:400:kworker.0 00010000:00080000:1.0:1788305584.627400:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38700 x1875174015228416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305584.627432:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015228416:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627448:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015227776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627459:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015228288:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627499:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015227648 00000100:00100000:1.0:1788305584.627503:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015227648 00000100:00100000:1.0:1788305584.627530:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788305584.627537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.627573:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015227648:12345-0@lo:400:kworker.0 Request processed in 36us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.627580:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788305584.641143:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015228032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.641261:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228544 00000100:00100000:1.0:1788305584.641270:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228544 00000100:00100000:1.0:1788305584.641392:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788305584.641401:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015228544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305584.641475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015228544:12345-0@lo:400:kworker.0 Request processed in 75us (30037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305584.641483:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:3.0:1788305584.641715:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305584.641835:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305584.641898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015227648:0@lo:400:kworker.0 00000100:00100000:2.0:1788305584.641916:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015228160:0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.642040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228672 00000100:00100000:3.0:1788305584.642045:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228672 00000100:00100000:3.0:1788305584.642099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788305584.642107:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015228672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305584.642150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015228672:12345-0@lo:400:kworker.0 Request processed in 44us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305584.642156:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00080000:1.0:1788305584.642217:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305584.642320:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015228544:0@lo:400:kworker.0 00010000:00080000:2.0:1788305584.642672:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d38000 x1875174015228672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305584.642684:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015228672:0@lo:400:kworker.0 00010000:00010000:0.0:1788305585.237585:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305586.261552:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305586.648570:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015228800:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305586.648651:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305586.648811:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228800 00000100:00100000:0.0:1788305586.648820:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228800 00000100:00100000:3.0:1788305586.648887:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015228928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305586.648890:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788305586.648900:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015228800:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305586.648919:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:0.0:1788305586.648935:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305586.648967:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015228928 00000100:00100000:3.0:1788305586.648971:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015228928 00000100:00100000:3.0:1788305586.648991:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788305586.648998:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015228928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305586.649028:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305586.649067:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015228928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305586.649073:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788305586.649117:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015228928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305586.660026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015228800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11111us (11358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305586.660055:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788305586.662142:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015228800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305586.801466:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801557:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801586:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801608:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801640:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305586.801689:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166400 00000100:00100000:1.0:1788305586.801698:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166400 00000100:00100000:3.0:1788305586.801720:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166272 00000100:00100000:3.0:1788305586.801725:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166272 00000100:00100000:3.0:1788305586.801751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166528 00000100:00100000:3.0:1788305586.801760:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166528 00000100:00100000:3.0:1788305586.801777:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166144 00000100:00100000:3.0:1788305586.801789:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166144 00000100:00100000:3.0:1788305586.801804:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166656 00000100:00100000:3.0:1788305586.801806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166656 00000100:00100000:3.0:1788305586.801823:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 261 00000100:00100000:3.0:1788305586.801831:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994166272:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305586.801928:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994166272:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 97us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305586.801936:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 261 00000100:00100000:0.0:1788305586.802078:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166016 00000100:00100000:0.0:1788305586.802082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166016 00000100:00100000:0.0:1788305586.802113:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 377 00000100:00100000:0.0:1788305586.802121:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994166016:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305586.802151:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889183e12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994166016:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305586.802158:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 377 00000100:00100000:0.0:1788305586.802188:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 262 00000100:00100000:0.0:1788305586.802195:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994166528:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305586.802221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994166528:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305586.802227:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 262 00000100:00100000:0.0:1788305586.802242:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 263 00000100:00100000:0.0:1788305586.802248:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166144:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305586.802438:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166144:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 189us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305586.802445:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 263 00000100:00100000:0.0:1788305586.802468:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 264 00000100:00100000:0.0:1788305586.802475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994166656:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305586.802501:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994166656:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305586.802507:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 264 00000100:00100000:1.0:1788305586.802583:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:1.0:1788305586.802593:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166400:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305586.802623:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166400:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (1014us total) trans 0 rc 0/0 00000100:00080000:2.0:1788305586.802708:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305586.802713:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305586.802716:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305586.811040:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00010000:00010000:2.0:1788305587.287792:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305588.310135:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305588.823082:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788305588.886253:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305589.339637:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305589.717846:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015229184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305589.717916:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305589.717996:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305589.718002:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015229056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305589.718026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.718157:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229184 00000100:00100000:1.0:1788305589.718165:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229184 00000100:00100000:1.0:1788305589.718229:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229056 00000100:00100000:1.0:1788305589.718232:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229056 00000100:00100000:1.0:1788305589.718253:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788305589.718264:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015229184:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305589.718313:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00002000:00000024:1.0:1788305589.718326:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305589.718326:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015229056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305589.718349:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305589.718384:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015229184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.718395:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788305589.718397:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015229056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305589.718405:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788305589.718484:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305589.718489:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305589.718534:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa36680 x1875174015229056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305589.718567:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015229056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305589.718584:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015229184:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305589.718860:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305589.718871:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015229312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305589.718904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305589.718932:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229312 00000100:00100000:3.0:1788305589.718936:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229312 00000100:00100000:3.0:1788305589.718966:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788305589.718972:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015229312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305589.718983:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305589.719013:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015229312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305589.719019:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788305589.719059:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015229312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305589.719249:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305589.719259:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015229440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305589.719316:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305589.719353:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305589.719456:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015229824:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.719483:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305589.719499:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015230336:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.719523:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305589.719543:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788305589.719549:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015229952:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.719571:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305589.719587:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015230464:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.719608:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305589.719633:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230336 00000100:00100000:2.0:1788305589.719636:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230336 00000100:00100000:1.0:1788305589.719741:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229440 00000100:00100000:1.0:1788305589.719745:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229440 00000100:00100000:1.0:1788305589.719777:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788305589.719783:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015229440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305589.719795:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305589.719831:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015229440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.719837:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788305589.719865:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229952 00000100:00100000:1.0:1788305589.719878:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229952 00000100:00100000:1.0:1788305589.719902:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230464 00000100:00100000:1.0:1788305589.719905:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230464 00000100:00100000:1.0:1788305589.719918:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788305589.719924:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015229952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.719954:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015229952:12345-0@lo:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.719961:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788305589.719971:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788305589.719978:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015230464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720000:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015230464:12345-0@lo:400:kworker.0 Request processed in 23us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.720006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788305589.720021:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015229696:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720042:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.720057:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015230208:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720087:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.720100:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788305589.720105:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015229568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720130:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.720150:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015230080:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720170:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.720186:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015230592:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305589.720224:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229568 00000100:00100000:1.0:1788305589.720227:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229568 00000100:00100000:1.0:1788305589.720262:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788305589.720268:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015229568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918a27c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015229568:12345-0@lo:400:kworker.0 Request processed in 61us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.720335:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788305589.720363:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229696 00000100:00100000:1.0:1788305589.720367:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229696 00000100:00100000:1.0:1788305589.720381:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230208 00000100:00100000:1.0:1788305589.720383:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230208 00000100:00100000:1.0:1788305589.720393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230592 00000100:00100000:1.0:1788305589.720395:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230592 00000100:00100000:1.0:1788305589.720409:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788305589.720415:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015229696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720443:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015229696:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.720448:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788305589.720460:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788305589.720467:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015230208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720492:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015230208:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.720498:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788305589.720507:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788305589.720513:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015230592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720537:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015230592:12345-0@lo:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305589.720542:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788305589.720571:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015229568:0@lo:400:kworker.0 00010000:00080000:1.0:1788305589.720591:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083e65180 x1875174015230592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305589.720601:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015230592:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720609:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015229696:0@lo:400:kworker.0 00000100:00100000:1.0:1788305589.720617:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015230208:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.721267:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788305589.721302:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015230336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.721348:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015230336:12345-0@lo:400:kworker.0 Request processed in 73us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305589.721355:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00080000:2.0:1788305589.721380:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305589.721384:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305589.721395:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305589.721419:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015229952:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.721430:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015230464:0@lo:400:kworker.0 00010000:00080000:2.0:1788305589.721440:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083e66a00 x1875174015230336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305589.721450:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015230336:0@lo:400:kworker.0 00010000:00080000:2.0:1788305589.721460:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa36680 x1875174015229440/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305589.721473:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015229440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305589.721949:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015229824 00000100:00100000:3.0:1788305589.721957:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015229824 00000100:00100000:3.0:1788305589.721986:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230080 00000100:00100000:3.0:1788305589.721988:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230080 00000100:00100000:3.0:1788305589.722000:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788305589.722007:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015229824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305589.722059:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015229824:12345-0@lo:400:kworker.0 Request processed in 52us (2575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305589.722066:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788305589.722768:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015229824:0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.722825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788305589.722835:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015230080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305589.722881:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015230080:12345-0@lo:400:kworker.0 Request processed in 50us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305589.722888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788305589.722984:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015230080:0@lo:400:kworker.0 00010000:00010000:2.0:1788305590.360376:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305591.383004:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305591.765984:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305591.766007:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015230720:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305591.766099:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305591.766556:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230720 00000100:00100000:0.0:1788305591.766566:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230720 00000100:00100000:0.0:1788305591.766627:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305591.766637:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015230720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305591.766673:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788305591.766734:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015230720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305591.766741:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788305591.766839:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015230720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305591.766978:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015230848:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305591.767012:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305591.767167:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230848 00000100:00100000:3.0:1788305591.767171:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230848 00000100:00100000:3.0:1788305591.767206:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788305591.767213:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015230848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305591.767232:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305591.767306:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015230848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305591.767313:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305591.767414:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015230848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305591.920367:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305591.920415:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305591.920441:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305591.920552:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166784 00000100:00100000:1.0:1788305591.920562:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166784 00000100:00100000:1.0:1788305591.920619:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 379 00000100:00100000:1.0:1788305591.920630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994166784:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305591.920700:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994166784:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305591.920709:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 379 00000100:00100000:2.0:1788305591.920992:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994166912 00000100:00100000:2.0:1788305591.920996:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994166912 00000100:00100000:2.0:1788305591.921046:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167040 00000100:00100000:2.0:1788305591.921049:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167040 00000100:00100000:2.0:1788305591.921071:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:2.0:1788305591.921095:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166912:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305591.921134:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994166912:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 42us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305591.921141:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 271 00000100:00100000:2.0:1788305591.921155:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00100000:2.0:1788305591.921162:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994167040:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305591.921185:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994167040:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305591.921192:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 272 00000100:00080000:1.0:1788305591.921519:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305591.921525:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305591.927496:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305591.927560:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305591.927588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305591.928061:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167296 00000100:00100000:3.0:1788305591.928072:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167296 00000100:00100000:3.0:1788305591.928144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167424 00000100:00100000:3.0:1788305591.928148:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167424 00000100:00100000:3.0:1788305591.928175:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:3.0:1788305591.928185:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994167296:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305591.928302:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994167296:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 89us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305591.928310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 273 00000100:00100000:3.0:1788305591.928328:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00100000:3.0:1788305591.928335:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994167424:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305591.928375:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994167424:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305591.928381:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 274 00000100:00080000:0.0:1788305591.928454:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305591.928458:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305591.928742:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167168 00000100:00100000:1.0:1788305591.928748:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167168 00000100:00100000:1.0:1788305591.928802:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788305591.928810:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994167168:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:1.0:1788305591.928828:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60536e1 00000100:00080000:1.0:1788305591.928836:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8891bfa6a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305591.928878:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:1.0:1788305591.929016:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+2:2394:x1875173994167168:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 207us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305591.929035:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00010000:00010000:2.0:1788305591.929300:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305591.929353:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788305592.405636:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305593.429750:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305594.453693:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305594.837482:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015230976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305594.837554:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305594.837758:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015231104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305594.837784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305594.837869:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015230976 00000100:00100000:0.0:1788305594.837878:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015230976 00000100:00100000:0.0:1788305594.837936:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231104 00000100:00100000:0.0:1788305594.837939:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231104 00000100:00100000:0.0:1788305594.837953:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788305594.837964:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015230976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305594.837994:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305594.838039:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015230976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.838046:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788305594.838059:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788305594.838065:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015231104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305594.838088:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305594.838112:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015231104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.838117:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788305594.838171:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305594.838175:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788305594.838198:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015231104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305594.838215:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015231104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305594.838396:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015230976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305594.838594:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015231360:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838630:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838651:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015231872:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838685:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838702:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015232384:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838720:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838736:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788305594.838741:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015231488:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838760:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838773:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015232000:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838788:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838797:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015232512:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.838842:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231360 00000100:00100000:3.0:1788305594.838845:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231360 00000100:00100000:3.0:1788305594.838867:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231872 00000100:00100000:3.0:1788305594.838869:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231872 00000100:00100000:3.0:1788305594.838882:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232384 00000100:00100000:3.0:1788305594.838884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232384 00000100:00100000:3.0:1788305594.838893:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232000 00000100:00100000:3.0:1788305594.838895:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232000 00000100:00100000:3.0:1788305594.838907:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788305594.838913:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015231360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838952:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015231360:12345-0@lo:400:kworker.0 Request processed in 40us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.838959:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788305594.838971:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788305594.838975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015231872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.838994:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015231872:12345-0@lo:400:kworker.0 Request processed in 19us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.838999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788305594.839007:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788305594.839012:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015232384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839030:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015232384:12345-0@lo:400:kworker.0 Request processed in 18us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.839035:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788305594.839042:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788305594.839047:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015232000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839064:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015232000:12345-0@lo:400:kworker.0 Request processed in 17us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.839069:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788305594.839086:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231488 00000100:00100000:3.0:1788305594.839088:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231488 00000100:00100000:3.0:1788305594.839107:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788305594.839112:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015231488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839136:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015231488:12345-0@lo:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.839141:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788305594.839167:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015231616:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.839200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015232128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839216:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.839243:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305594.839249:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015231232:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839270:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.839309:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015231744:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839327:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.839339:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015232256:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305594.839372:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231616 00000100:00100000:3.0:1788305594.839375:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231616 00000100:00100000:3.0:1788305594.839393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232256 00000100:00100000:3.0:1788305594.839395:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232256 00000100:00100000:3.0:1788305594.839407:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788305594.839412:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015231616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839440:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015231616:12345-0@lo:400:kworker.0 Request processed in 28us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.839446:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788305594.839455:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788305594.839460:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015232256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839479:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015232256:12345-0@lo:400:kworker.0 Request processed in 19us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305594.839484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788305594.839511:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015231488:0@lo:400:kworker.0 00010000:00080000:3.0:1788305594.839530:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf93aa00 x1875174015232000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305594.839540:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015232000:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839549:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015231360:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839556:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015231872:0@lo:400:kworker.0 00010000:00080000:3.0:1788305594.839564:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf939500 x1875174015232384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305594.839572:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015232384:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015232256:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.839604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015231616:0@lo:400:kworker.0 00000100:00100000:0.0:1788305594.839715:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232512 00000100:00100000:0.0:1788305594.839719:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232512 00000100:00100000:0.0:1788305594.839741:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232128 00000100:00100000:0.0:1788305594.839743:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232128 00000100:00100000:0.0:1788305594.839760:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305594.839766:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015232512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305594.839809:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015232512:12345-0@lo:400:kworker.0 Request processed in 43us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.839815:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788305594.839826:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305594.839830:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015232128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305594.839850:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015232128:12345-0@lo:400:kworker.0 Request processed in 20us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.839856:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305594.839871:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231744 00000100:00100000:0.0:1788305594.839874:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231744 00000100:00100000:0.0:1788305594.839891:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788305594.839896:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015231744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305594.839919:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015231744:12345-0@lo:400:kworker.0 Request processed in 23us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.839925:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00080000:0.0:1788305594.839945:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf93ad80 x1875174015232512/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305594.839955:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015232512:0@lo:400:kworker.0 00000100:00080000:2.0:1788305594.840021:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305594.840024:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305594.840032:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305594.840034:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305594.840047:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305594.840056:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305594.840082:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305594.840148:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232640 00000100:00100000:0.0:1788305594.840152:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232640 00000100:00100000:0.0:1788305594.840178:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788305594.840184:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015232640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305594.840197:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305594.840227:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015232640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305594.840254:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788305594.840531:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015232640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305594.840545:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015232768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305594.840551:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015231232 00000100:00100000:1.0:1788305594.840555:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015231232 00000100:00100000:2.0:1788305594.840570:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305594.840582:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788305594.840588:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015231232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305594.840596:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232768 00000100:00100000:2.0:1788305594.840599:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232768 00000100:00100000:2.0:1788305594.840620:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788305594.840622:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015231232:12345-0@lo:400:kworker.0 Request processed in 35us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305594.840626:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015232768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305594.840628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00002000:00000024:2.0:1788305594.840635:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788305594.840665:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015232768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305594.840671:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:2.0:1788305594.840693:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa34e00 x1875174015232768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305610 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305594.840707:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015232768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305594.842194:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015231232:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.842212:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015231744:0@lo:400:kworker.0 00000100:00100000:3.0:1788305594.842224:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015232128:0@lo:400:kworker.0 00010000:00010000:2.0:1788305595.477534:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305596.501598:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305596.885881:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305596.885906:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015232896:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305596.886002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305596.886288:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015232896 00000100:00100000:3.0:1788305596.886297:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015232896 00000100:00100000:3.0:1788305596.886355:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788305596.886366:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015232896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305596.886400:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305596.886452:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015232896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305596.886459:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788305596.886845:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015232896:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305596.887693:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305596.887708:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015233024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305596.887761:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305596.889060:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233024 00000100:00100000:3.0:1788305596.889072:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233024 00000100:00100000:3.0:1788305596.889136:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788305596.889146:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015233024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305596.889191:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305596.889309:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015233024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 163us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305596.889316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788305596.889467:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015233024:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305597.037775:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305597.037818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305597.037867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305597.037895:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305597.037919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305597.037946:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167552 00000100:00100000:3.0:1788305597.037955:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167552 00000100:00100000:3.0:1788305597.038004:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 381 00000100:00100000:3.0:1788305597.038014:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994167552:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305597.038080:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af37b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994167552:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305597.038087:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 381 00000100:00100000:3.0:1788305597.038119:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167680 00000100:00100000:3.0:1788305597.038123:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167680 00000100:00100000:3.0:1788305597.038153:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167936 00000100:00100000:3.0:1788305597.038156:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167936 00000100:00100000:3.0:1788305597.038183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994167808 00000100:00100000:3.0:1788305597.038186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994167808 00000100:00100000:3.0:1788305597.038197:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168064 00000100:00100000:3.0:1788305597.038199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168064 00000100:00100000:3.0:1788305597.038355:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 281 00000100:00100000:3.0:1788305597.038374:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994167680:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305597.038406:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994167680:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 35us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305597.038413:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 281 00000100:00100000:1.0:1788305597.038538:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:1.0:1788305597.038548:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994167936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305597.038577:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994167936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305597.038582:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 282 00000100:00100000:3.0:1788305597.038616:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 283 00000100:00100000:3.0:1788305597.038624:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994167808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305597.038653:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994167808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305597.038660:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 283 00000100:00100000:0.0:1788305597.038715:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00100000:0.0:1788305597.038726:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305597.038755:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 33us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305597.038762:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 284 00000100:00080000:1.0:1788305597.046148:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305597.046173:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305597.525482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788305597.918732:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:1.0:1788305597.918741:0:8431:0:(genops.c:885:class_export_put()) final put ffff8891bfa68000/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:2.0:1788305597.922917:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bfa68000/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-OST0000 00000020:00000080:2.0:1788305597.926160:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bfa6a800 for lustre-OST0000 00000040:00080000:3.0:1788305598.042472:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788305598.102870:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305598.554084:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305599.573851:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305599.957589:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015233408:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.957658:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015233280:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.957710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.957768:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015233920:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957790:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.957807:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015234432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957823:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.957851:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788305599.957856:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015233536:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.957911:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015234048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957932:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.957961:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015234560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.957978:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305599.958144:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233408 00000100:00100000:3.0:1788305599.958152:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233408 00000100:00100000:3.0:1788305599.958383:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305599.958394:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015233408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958446:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015233408:12345-0@lo:400:kworker.0 Request processed in 54us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958453:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305599.958473:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233280 00000100:00100000:3.0:1788305599.958477:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233280 00000100:00100000:3.0:1788305599.958493:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233920 00000100:00100000:3.0:1788305599.958495:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233920 00000100:00100000:3.0:1788305599.958513:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234432 00000100:00100000:3.0:1788305599.958515:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234432 00000100:00100000:3.0:1788305599.958525:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233536 00000100:00100000:3.0:1788305599.958527:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233536 00000100:00100000:3.0:1788305599.958538:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788305599.958542:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015233280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015233280:12345-0@lo:400:kworker.0 Request processed in 26us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788305599.958585:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788305599.958590:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015233920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958609:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015233920:12345-0@lo:400:kworker.0 Request processed in 19us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958614:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788305599.958622:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788305599.958626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015234432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958643:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015234432:12345-0@lo:400:kworker.0 Request processed in 17us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958655:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788305599.958677:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788305599.958683:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015233536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015233536:12345-0@lo:400:kworker.0 Request processed in 24us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958711:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788305599.958730:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234048 00000100:00100000:3.0:1788305599.958733:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234048 00000100:00100000:3.0:1788305599.958754:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234560 00000100:00100000:3.0:1788305599.958756:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234560 00000100:00100000:3.0:1788305599.958770:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788305599.958775:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015234048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958798:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015234048:12345-0@lo:400:kworker.0 Request processed in 23us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958804:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788305599.958812:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788305599.958817:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015234560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958835:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015234560:12345-0@lo:400:kworker.0 Request processed in 18us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305599.958840:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788305599.958884:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015233536:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958893:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015234048:0@lo:400:kworker.0 00010000:00080000:3.0:1788305599.958904:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf939500 x1875174015234560/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305599.958914:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015234560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305599.958930:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015233408:0@lo:400:kworker.0 00010000:00080000:3.0:1788305599.958939:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf939880 x1875174015233920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305599.958948:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015233920:0@lo:400:kworker.0 00010000:00080000:3.0:1788305599.958956:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf939180 x1875174015234432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305599.958963:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015234432:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960482:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015233280:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960494:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960667:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960706:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015234304:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960733:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960776:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015234816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305599.960804:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788305599.960834:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015233152:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960891:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015233664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960917:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960935:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015234176:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.960961:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.960981:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015234688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961006:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.961041:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233792 00000100:00100000:1.0:1788305599.961047:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233792 00000100:00100000:1.0:1788305599.961087:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234304 00000100:00100000:1.0:1788305599.961091:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234304 00000100:00100000:1.0:1788305599.961179:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788305599.961198:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015233792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961248:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015233792:12345-0@lo:400:kworker.0 Request processed in 52us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961256:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788305599.961273:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788305599.961299:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015234304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961335:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015234304:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1788305599.961360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305599.961365:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305599.961367:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305599.961369:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305599.961378:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234176 00000100:00100000:1.0:1788305599.961382:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234176 00000100:00100000:1.0:1788305599.961409:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234688 00000100:00100000:1.0:1788305599.961411:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234688 00000100:00100000:1.0:1788305599.961423:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305599.961429:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015234176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961458:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015234176:12345-0@lo:400:kworker.0 Request processed in 29us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961463:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305599.961473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305599.961478:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015234688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961500:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015234688:12345-0@lo:400:kworker.0 Request processed in 22us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961505:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305599.961556:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234816 00000100:00100000:1.0:1788305599.961560:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234816 00000100:00100000:1.0:1788305599.961583:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788305599.961589:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015234816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305599.961609:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305599.961636:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015234816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961648:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788305599.961665:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233152 00000100:00100000:1.0:1788305599.961668:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233152 00000100:00100000:1.0:1788305599.961694:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788305599.961700:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015233152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961732:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af379450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015233152:12345-0@lo:400:kworker.0 Request processed in 32us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305599.961738:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00080000:1.0:1788305599.961760:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305599.961763:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305599.961780:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305599.961789:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015234944:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305599.961814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305599.961856:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015233152:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961868:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015234176:0@lo:400:kworker.0 00010000:00080000:1.0:1788305599.961878:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf93a300 x1875174015234688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305599.961888:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015234688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961901:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015234816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305599.961910:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015233792:0@lo:400:kworker.0 00000100:00100000:1.0:1788305599.961918:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015234304:0@lo:400:kworker.0 00000100:00100000:0.0:1788305599.977756:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015233664 00000100:00100000:0.0:1788305599.977766:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015233664 00000100:00100000:0.0:1788305599.977819:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788305599.977831:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015233664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305599.977926:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015233664:12345-0@lo:400:kworker.0 Request processed in 98us (17008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305599.977935:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788305599.977972:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015234944 00000100:00100000:0.0:1788305599.977976:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015234944 00000100:00100000:0.0:1788305599.978001:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788305599.978008:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015234944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305599.978239:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305599.978307:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015234944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (16491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305599.978314:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788305599.978344:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015235200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305599.978388:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305599.978429:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235200 00000100:00100000:0.0:1788305599.978433:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235200 00000100:00100000:0.0:1788305599.978460:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788305599.978467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015235200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305599.978477:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305599.978512:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015235200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305599.978519:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:0.0:1788305599.978558:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918356c000 x1875174015235200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305599.978578:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015235200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305599.978616:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015233664:0@lo:400:kworker.0 00000100:00100000:2.0:1788305599.979162:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305599.979175:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015235072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305599.979235:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788305599.979804:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083e66300 x1875174015234944/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305599.979825:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015234944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305599.979921:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235072 00000100:00100000:0.0:1788305599.979928:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235072 00000100:00100000:0.0:1788305599.979977:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788305599.979986:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015235072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305599.980002:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305599.980058:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015235072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305599.980064:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788305599.984894:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015235072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788305600.597510:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305601.623166:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305602.005612:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015235328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305602.005698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305602.005947:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235328 00000100:00100000:3.0:1788305602.005957:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235328 00000100:00100000:3.0:1788305602.006027:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788305602.006039:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015235328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305602.006075:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788305602.006135:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015235328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305602.006154:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305602.006262:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015235328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305602.007845:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015235456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305602.007920:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305602.008019:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235456 00000100:00100000:0.0:1788305602.008036:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235456 00000100:00100000:0.0:1788305602.008101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788305602.008112:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015235456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305602.008152:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305602.009600:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015235456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 870us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305602.009615:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788305602.011652:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015235456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305602.159247:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305602.159325:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305602.159355:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305602.159387:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305602.159412:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305602.159440:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168448 00000100:00100000:1.0:1788305602.159440:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168704 00000100:00100000:3.0:1788305602.159449:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168448 00000100:00100000:1.0:1788305602.159449:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168704 00000100:00100000:0.0:1788305602.159511:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168320 00000100:00100000:0.0:1788305602.159515:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168320 00000100:00100000:1.0:1788305602.159578:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168576 00000100:00100000:1.0:1788305602.159581:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168576 00000100:00100000:2.0:1788305602.159640:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168192 00000100:00100000:2.0:1788305602.159645:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168192 00000100:00100000:2.0:1788305602.159679:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 383 00000100:00100000:2.0:1788305602.159690:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994168192:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305602.159761:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af378450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2398:x1875173994168192:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305602.159769:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 383 00000100:00100000:2.0:1788305602.159806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 291 00000100:00100000:2.0:1788305602.163125:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168704:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305602.163222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168704:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 3409us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305602.163234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 291 00000100:00100000:0.0:1788305602.163535:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:0.0:1788305602.163546:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994168320:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305602.163584:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994168320:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (4196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305602.163590:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 292 00000100:00100000:1.0:1788305602.167778:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 293 00000100:00100000:1.0:1788305602.167795:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168576:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305602.167887:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994168576:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 96us (8473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305602.167908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 293 00000100:00080000:2.0:1788305602.172428:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305602.172442:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305602.173674:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 294 00000100:00100000:3.0:1788305602.174068:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994168448:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305602.174242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2398:x1875173994168448:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 557us (14915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305602.174264:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 294 00010000:00010000:1.0:1788305602.646474:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305603.670626:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788305603.790915:0:14070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:33:21 (1788305601) 00010000:00010000:1.0:1788305604.693564:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305605.077639:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015235968:0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.077750:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305605.077855:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015236480:0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.077894:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305605.077925:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015235712:0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.077929:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015236992:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.077953:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235968 00000100:00100000:0.0:1788305605.077960:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235968 00000100:00100000:2.0:1788305605.077971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305605.077992:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788305605.077999:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015235584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.078104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.078161:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235712 00000100:00100000:0.0:1788305605.078168:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235712 00000100:00100000:3.0:1788305605.078184:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015236224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.078207:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788305605.078221:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015235968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.078233:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.078317:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015235968:12345-0@lo:400:kworker.0 Request processed in 98us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.078327:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788305605.078349:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788305605.078355:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015235712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.078401:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015235712:12345-0@lo:400:kworker.0 Request processed in 46us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.078408:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788305605.078487:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015235840:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.078523:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.078550:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015236352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.078584:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235840 00000100:00100000:0.0:1788305605.078588:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235840 00000100:00100000:3.0:1788305605.078626:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015236736:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.078627:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305605.078646:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015235840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.078682:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.078704:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015235840:12345-0@lo:400:kworker.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.078713:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788305605.078719:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015237248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305605.078749:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236224 00000100:00100000:0.0:1788305605.078755:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236224 00000100:00100000:3.0:1788305605.078761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305605.078829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015235712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.078871:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237248 00000100:00100000:3.0:1788305605.078877:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237248 00000100:00100000:3.0:1788305605.078923:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788305605.078933:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015237248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305605.078968:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305605.079013:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015237248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305605.079270:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305605.079361:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015236096:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.079550:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236480 00000100:00100000:1.0:1788305605.079556:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236480 00000100:00100000:1.0:1788305605.079593:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236992 00000100:00100000:1.0:1788305605.079597:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236992 00000100:00100000:2.0:1788305605.079625:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305605.079634:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788305605.079644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015236480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.079667:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015236608:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.079728:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015236480:12345-0@lo:400:kworker.0 Request processed in 78us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305605.079729:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305605.079746:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305605.079764:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015237120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.079769:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236608 00000100:00100000:1.0:1788305605.079774:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236608 00000100:00100000:1.0:1788305605.079793:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788305605.079817:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305605.079822:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015236992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.079867:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015236480:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.079880:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015236992:12345-0@lo:400:kworker.0 Request processed in 62us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305605.079888:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:2.0:1788305605.079895:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891903fd500 x1875174015236992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305605.079902:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237120 00000100:00100000:1.0:1788305605.079908:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237120 00000100:00100000:2.0:1788305605.079914:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015236992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.079944:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015235968:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.079945:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788305605.079962:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015236608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.079991:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015237504:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305605.080020:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015236608:12345-0@lo:400:kworker.0 Request processed in 60us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305605.080028:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788305605.080043:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788305605.080049:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305605.080059:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015237120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.080110:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015236608:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.080118:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015237120:12345-0@lo:400:kworker.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305605.080131:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:2.0:1788305605.080143:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891903fdf80 x1875174015237120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305605.080180:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015237120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.080191:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236096 00000100:00100000:1.0:1788305605.080198:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236096 00000100:00100000:0.0:1788305605.080200:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236736 00000100:00100000:0.0:1788305605.080208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236736 00000100:00080000:2.0:1788305605.080253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305605.080253:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788305605.080262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00080000:2.0:1788305605.080265:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305605.080270:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305605.080296:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015236224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305605.080323:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015236096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.080339:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237504 00000100:00100000:2.0:1788305605.080346:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237504 00000100:00100000:0.0:1788305605.080366:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015236224:12345-0@lo:400:kworker.0 Request processed in 96us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.080376:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788305605.080391:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788305605.080399:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015236736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.080440:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015236736:12345-0@lo:400:kworker.0 Request processed in 43us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.080456:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788305605.080488:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.080512:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015236864:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.080536:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.080553:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015237376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305605.080592:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.080620:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015235840:0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.080639:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236352 00000100:00100000:0.0:1788305605.080642:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236352 00000100:00100000:0.0:1788305605.080668:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015236864 00000100:00100000:0.0:1788305605.080671:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015236864 00000100:00100000:0.0:1788305605.080688:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788305605.080694:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015236352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.080734:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015236352:12345-0@lo:400:kworker.0 Request processed in 41us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.080740:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788305605.080752:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788305605.080758:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015236864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.080789:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788305605.080817:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237376 00000100:00100000:3.0:1788305605.080822:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237376 00000100:00100000:2.0:1788305605.080873:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788305605.080884:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015237504:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305605.080910:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305605.081485:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015236096:12345-0@lo:400:kworker.0 Request processed in 1213us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305605.081674:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305605.081688:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015237376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305605.081707:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305605.081758:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015237376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305605.081778:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788305605.081842:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015236224:0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.081859:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015236736:0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.081879:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918356ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015237248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788305605.081934:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305605.081985:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788305605.082888:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015236864:12345-0@lo:400:kworker.0 Request processed in 2122us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.082901:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00080000:0.0:1788305605.085335:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891903fd880 x1875174015236352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305605.085367:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015236352:0@lo:400:kworker.0 00010000:00080000:0.0:1788305605.085412:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891903fd180 x1875174015236864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305605.085440:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015236864:0@lo:400:kworker.0 00010000:00080000:0.0:1788305605.085458:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bf9b5500 x1875174015237376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305605.085478:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015237376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305605.085747:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015235584 00000100:00100000:0.0:1788305605.085754:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015235584 00000100:00100000:0.0:1788305605.085814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788305605.085823:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015235584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305605.085901:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015235584:12345-0@lo:400:kworker.0 Request processed in 79us (6635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.085908:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788305605.085910:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015237504:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5027us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305605.085917:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788305605.085945:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015237632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305605.085978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305605.086007:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237632 00000100:00100000:0.0:1788305605.086011:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237632 00000100:00100000:0.0:1788305605.086034:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788305605.086042:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015237632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305605.086057:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305605.086092:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015237632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.086098:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:3.0:1788305605.086246:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e2d80 x1875174015237504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305605.086291:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015237504:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305605.086308:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015235584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305605.086320:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015236096:0@lo:400:kworker.0 00000100:00100000:2.0:1788305605.087204:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015237632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305605.310101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305605.310238:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168832 00000100:00100000:2.0:1788305605.310247:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168832 00000100:00100000:2.0:1788305605.310347:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788305605.310357:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:11081:x1875173994168832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305605.310378:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305605.310403:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e60537c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083a7 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.310471:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.310984:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.310997:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305605.311051:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305605.311055:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305605.311097:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.311126:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e60537c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a7 expref: 7 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.311157:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a7 expref: 6 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305605.311166:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9b00) 00010000:00010000:2.0:1788305605.311168:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305605.311172:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305605.311736:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:11081:x1875173994168832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305605.311746:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00080000:3.0:1788305605.311834:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305605.323449:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305605.326194:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994168960 00000100:00100000:0.0:1788305605.326211:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994168960 00000100:00100000:0.0:1788305605.326496:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305605.326507:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:11082:x1875173994168960:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305605.326545:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305605.326568:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60537cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083ae expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326636:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326651:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326664:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326679:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326686:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326693:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326779:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326849:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326857:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305605.326906:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305605.326916:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305605.326946:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326959:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326965:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326972:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326978:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305605.326983:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.326991:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327004:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9b00) 00010000:00010000:0.0:1788305605.327007:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305605.327011:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327017:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327032:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327038:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327054:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327059:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305605.327063:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327069:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327078:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88908337b900) 00010000:00010000:0.0:1788305605.327080:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305605.327084:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327089:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60537cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ae expref: 8 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327144:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ae expref: 7 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.327152:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88908337bd00) 00010000:00010000:0.0:1788305605.327155:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305605.327158:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ba00, rc 0) 00000100:00100000:0.0:1788305605.327322:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11082:x1875173994168960:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 817us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.327339:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:1.0:1788305605.338240:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305605.338597:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169088 00000100:00100000:3.0:1788305605.338610:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169088 00000100:00100000:3.0:1788305605.338690:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305605.338703:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11082:x1875173994169088:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788305605.338818:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11082:x1875173994169088:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 Request processed in 117us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305605.338828:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:1.0:1788305605.347442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305605.347556:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169344 00000100:00100000:0.0:1788305605.347571:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169344 00000100:00100000:0.0:1788305605.347654:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788305605.347669:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11082:x1875173994169344:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305605.347702:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305605.347743:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60537eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083b5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.347850:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.347870:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.347895:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348058:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348084:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348098:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348243:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053800 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348272:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053800 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348341:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053800 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305605.348355:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788305605.348471:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348479:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348492:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348499:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305605.348503:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348511:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348524:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88908337bd00) 00010000:00010000:0.0:1788305605.348528:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305605.348532:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348538:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e60537f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348551:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348566:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348572:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348577:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305605.348581:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348587:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348596:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff88908337b900) 00010000:00010000:0.0:1788305605.348599:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305605.348602:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348608:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e60537f9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60537eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083b5 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348911:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053800 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083b5 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305605.348918:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:0.0:1788305605.348921:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305605.348929:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a400, rc 0) 00000100:00100000:0.0:1788305605.348997:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11082:x1875173994169344:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1331us (1573us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788305605.349006:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788305605.358534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305605.358611:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169472 00000100:00100000:0.0:1788305605.358622:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169472 00000100:00100000:0.0:1788305605.358693:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788305605.358705:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11082:x1875173994169472:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788305605.358849:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11082:x1875173994169472:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 145us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305605.358857:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788305605.362838:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305605.362987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169600 00000100:00100000:0.0:1788305605.362997:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169600 00000100:00100000:0.0:1788305605.363097:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788305605.363108:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:11082:x1875173994169600:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1788305605.367580:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4400us 00000100:00080000:3.0:1788305605.367817:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305605.390396:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:11082:x1875173994169600:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 27279us (27559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305605.390413:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00010000:00010000:0.0:1788305605.717559:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788305606.233447:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788305606.303435:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305606.741519:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305607.125665:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305607.125708:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015237760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305607.125809:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305607.125917:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237760 00000100:00100000:1.0:1788305607.125928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237760 00000100:00100000:1.0:1788305607.125992:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788305607.126003:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015237760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305607.126050:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788305607.126110:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015237760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305607.126131:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788305607.126199:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015237760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305607.126407:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015237888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305607.126462:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305607.126621:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015237888 00000100:00100000:0.0:1788305607.126627:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015237888 00000100:00100000:0.0:1788305607.126677:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788305607.126685:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015237888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305607.126708:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788305607.126753:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015237888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305607.126758:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788305607.126789:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015237888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305607.292939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305607.292989:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305607.293023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169728 00000100:00100000:3.0:1788305607.293037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169728 00000100:00100000:3.0:1788305607.293109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 385 00000100:00100000:3.0:1788305607.293136:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994169728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305607.293234:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994169728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305607.293242:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 385 00000100:00100000:3.0:1788305607.293311:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169856 00000100:00100000:3.0:1788305607.293316:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169856 00000100:00100000:3.0:1788305607.293859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 301 00000100:00100000:3.0:1788305607.293868:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994169856:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305607.293918:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994169856:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 52us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305607.293925:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 301 00000100:00080000:3.0:1788305607.294089:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305607.314402:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305607.314469:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305607.314512:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994169984 00000100:00100000:2.0:1788305607.314525:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994169984 00000100:00100000:2.0:1788305607.314599:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170240 00000100:00100000:2.0:1788305607.314601:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170240 00000100:00100000:2.0:1788305607.314633:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:2.0:1788305607.314645:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994169984:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305607.314752:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994169984:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305607.314761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 302 00000100:00100000:2.0:1788305607.314782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 303 00000100:00100000:2.0:1788305607.314789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994170240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305607.314813:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994170240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305607.314819:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 303 00000100:00080000:2.0:1788305607.314836:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305607.327439:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.329003:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170112 00000100:00100000:0.0:1788305607.329095:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170112 00000100:00100000:0.0:1788305607.330144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00100000:0.0:1788305607.330162:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994170112:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305607.330309:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994170112:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 150us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305607.330317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 304 00000100:00080000:3.0:1788305607.332299:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305607.582158:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305607.582206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170368 00000100:00100000:2.0:1788305607.582216:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170368 00000100:00100000:2.0:1788305607.582296:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305607.582308:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11124:x1875173994170368:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305607.582328:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305607.582348:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605380e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083bc expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582413:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582440:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582455:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582470:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582476:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582482:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582524:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582531:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582538:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582544:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305607.582548:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582555:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582565:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9b00) 00010000:00010000:2.0:1788305607.582573:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305607.582578:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582583:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582595:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582601:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582606:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582611:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305607.582615:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582620:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582627:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff88908362e300) 00010000:00010000:2.0:1788305607.582629:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305607.582632:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582636:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605381c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582671:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605380e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083bc expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582692:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9b00) 00010000:00010000:2.0:1788305607.582694:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305607.582698:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e605380e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083bc expref: 10 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.582707:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:2.0:1788305607.582766:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11124:x1875173994170368:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 459us (626us total) trans 0 rc 301/301 00000100:00100000:2.0:1788305607.582773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:0.0:1788305607.594494:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.594530:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170624 00000100:00100000:0.0:1788305607.594538:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170624 00000100:00100000:0.0:1788305607.594590:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:0.0:1788305607.594599:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:11124:x1875173994170624:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:0.0:1788305607.594658:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305607.594686:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60537c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a7 expref: 9 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594703:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8891833f9b00) 00010000:00010000:0.0:1788305607.594714:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305607.594775:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594788:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594798:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594810:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594825:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.594833:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597754:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597776:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597787:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305607.597805:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ff4a4ad reply state 00000000cce525a1 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597815:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597823:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305607.597825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305607.597829:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788305607.597836:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788305607.597843:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597850:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597857:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.597872:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305607.598735:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.598745:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.598758:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305607.598760:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305607.598764:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.598770:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053823 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305607.598789:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ff4a4ad reply state 00000000cce525a1 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.598798:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.598804:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8890825bbf00) 00010000:00010000:0.0:1788305607.598807:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305607.598809:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788305607.601093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:11124:x1875173994170624:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 6483us (6597us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788305607.601106:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:2.0:1788305607.753123:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.753264:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170752 00000100:00100000:0.0:1788305607.753302:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170752 00000100:00100000:0.0:1788305607.753371:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:0.0:1788305607.753399:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:11132:x1875173994170752:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:0.0:1788305607.753424:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305607.754239:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053838 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083c3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755690:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755712:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755725:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305607.755772:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305607.755776:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305607.755817:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755848:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053838 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083c3 expref: 12 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755869:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083c3 expref: 11 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.755877:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305607.755880:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305607.755883:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523be00, rc 0) 00000100:00100000:0.0:1788305607.755961:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:11132:x1875173994170752:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 2563us (2856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305607.755984:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00010000:00010000:1.0:1788305607.766175:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305607.834427:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305607.834653:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994170880 00000100:00100000:2.0:1788305607.834664:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994170880 00000100:00100000:2.0:1788305607.834724:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788305607.834735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:11138:x1875173994170880:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305607.834753:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305607.834772:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083ca expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.834830:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.834843:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.834852:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835243:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835251:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835259:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835425:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835433:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835440:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305607.835477:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788305607.835480:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305607.835520:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835532:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835538:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835545:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835561:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305607.835565:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835573:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835584:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:2.0:1788305607.835587:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305607.835592:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835598:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605384d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835611:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835617:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835622:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835627:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305607.835630:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835635:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835653:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8890825bbf00) 00010000:00010000:2.0:1788305607.835655:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305607.835658:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835664:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053854 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835694:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ca expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835708:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ca expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.835715:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305607.835717:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788305607.835720:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:2.0:1788305607.835870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:11138:x1875173994170880:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1135us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305607.835879:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788305607.851982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.852182:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171136 00000100:00100000:0.0:1788305607.852195:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171136 00000100:00100000:0.0:1788305607.852271:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:0.0:1788305607.852322:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:11138:x1875173994171136:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305607.852644:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305607.852674:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053862 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083d1 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.852817:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.852836:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.852851:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.854059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.854085:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.854117:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305607.854876:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788305607.855045:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855064:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855073:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855125:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855133:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855140:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855146:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305607.855151:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855159:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855171:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305607.855175:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305607.855179:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855185:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053869 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305607.855199:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fced96e5 reply state 00000000388c89ce transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855217:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855223:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:0.0:1788305607.855226:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305607.855229:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305607.855270:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053862 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855344:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.855352:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:0.0:1788305607.855355:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305607.855357:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031400, rc 0) 00000100:00100000:0.0:1788305607.855430:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11138:x1875173994171136:12345-192.168.202.55@tcp:101:bash.0 Request processed in 3111us (3461us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788305607.855439:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788305607.877012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305607.877143:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171264 00000100:00100000:1.0:1788305607.877161:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171264 00000100:00100000:1.0:1788305607.877232:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788305607.877242:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994171264:12345-192.168.202.55@tcp:8:bash.0 00010000:00080000:1.0:1788305607.877316:0:8436:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1788305607.877348:0:8436:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e6053885 00002000:00100000:1.0:1788305607.877360:0:8436:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891/ffff8891bfa6c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305607.877397:0:8436:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305607.877475:0:8436:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788305607.877507:0:8436:0:(import.c:65:import_set_state_nolock()) ffff8891bfa68800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305607.877589:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994171264:12345-192.168.202.55@tcp:8:bash.0 Request processed in 346us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305607.877597:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788305607.887371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.887473:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171392 00000100:00100000:0.0:1788305607.887481:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171392 00000100:00100000:0.0:1788305607.887558:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:0.0:1788305607.887568:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:0:x1875173994171392:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305607.887586:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305607.887609:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083d8 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305607.887634:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305607.887663:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=437s v=(0 0) 00010000:00010000:0.0:1788305607.887667:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305607.887676:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.887695:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 7 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305607.887708:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031c00, rc 0) 00000100:00100000:0.0:1788305607.887866:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:0:x1875173994171392:12345-192.168.202.55@tcp:101:bash.0 Request processed in 298us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305607.887873:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00080000:3.0:1788305607.888211:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305607.899939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305607.900773:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171520 00000100:00100000:1.0:1788305607.900785:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171520 00000100:00100000:1.0:1788305607.900858:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788305607.900869:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11138:x1875173994171520:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305607.900888:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305607.900911:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083df expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305607.900941:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305607.900951:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305607.900955:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305607.900960:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305607.900996:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305607.901009:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 8 pid: 8437 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305607.901038:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875174015238016:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305607.901262:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305607.906708:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875174015238016:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305607.906745:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305607.907398:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51e00, rc 0) 00000100:00100000:0.0:1788305607.907983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305607.908459:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171648 00000100:00100000:2.0:1788305607.908467:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171648 00010000:00010000:2.0:1788305607.908504:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 9 pid: 8437 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305607.908548:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788305607.908573:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994171648:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305607.908590:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305607.908626:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 9 pid: 8437 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.908641:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 9 pid: 8437 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.908669:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e605388c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d8 expref: 9 pid: 8437 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.908689:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305607.908693:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305607.908701:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.908711:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305607.908748:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305607.908817:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1875174015238144:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788305607.909378:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891839589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305607.910541:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:11138:x1875173994171520:12345-192.168.202.55@tcp:101:bash.0 Request processed in 9665us (10603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305607.910553:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:2.0:1788305607.925046:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305607.925171:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836d6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6505:1875174015238144:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305607.925197:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305607.925257:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994171648:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 16685us (17277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305607.925268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:3.0:1788305607.925739:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994171904 00000100:00100000:3.0:1788305607.925747:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994171904 00000100:00100000:3.0:1788305607.925798:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:3.0:1788305607.925809:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11138:x1875173994171904:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788305607.926087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11138:x1875173994171904:12345-192.168.202.55@tcp:35:bash.0 Request processed in 278us (1051us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788305607.926095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788305608.041866:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.042012:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994172160 00000100:00100000:0.0:1788305608.042022:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994172160 00000100:00100000:0.0:1788305608.042087:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:0.0:1788305608.042098:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11148:x1875173994172160:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305608.042132:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305608.042154:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605389a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305608.042325:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788305608.042418:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605389a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083e6 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.042433:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305608.042436:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305608.042442:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605389a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083e6 expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.042457:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031c00, rc 0) 00000100:00100000:0.0:1788305608.042521:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11148:x1875173994172160:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 425us (665us total) trans 4294967315 rc 301/301 00000100:00100000:0.0:1788305608.042529:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788305608.046086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.046630:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994172416 00000100:00100000:3.0:1788305608.046644:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994172416 00000100:00100000:3.0:1788305608.046820:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305608.046834:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11148:x1875173994172416:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305608.047194:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11148:x1875173994172416:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 363us (1122us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788305608.047203:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305608.170558:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.170838:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994172544 00000100:00100000:2.0:1788305608.170852:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994172544 00000100:00100000:2.0:1788305608.171002:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:2.0:1788305608.171017:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11154:x1875173994172544:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305608.171062:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305608.171091:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60538a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083ed expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171227:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171255:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171321:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305608.171378:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788305608.171382:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305608.171411:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171443:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60538a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ed expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171465:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ed expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.171475:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305608.171495:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305608.171499:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:2.0:1788305608.171581:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11154:x1875173994172544:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 568us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305608.171590:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788305608.177550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.179480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994172800 00000100:00100000:0.0:1788305608.179501:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994172800 00000100:00100000:0.0:1788305608.179594:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788305608.179606:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11154:x1875173994172800:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305608.179635:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305608.179663:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e60538b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083f4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.180465:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60538bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.180485:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60538bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.180521:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60538bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305608.180535:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788305608.181099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e60538b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083f4 expref: 22 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.181135:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60538bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083f4 expref: 21 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.181146:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:0.0:1788305608.181149:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305608.181153:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b800, rc 0) 00000100:00100000:0.0:1788305608.182426:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:11154:x1875173994172800:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 2810us (4879us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788305608.182439:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788305608.191435:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305608.192197:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.192450:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173184 00000100:00100000:3.0:1788305608.192464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173184 00000100:00100000:3.0:1788305608.192686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:3.0:1788305608.192699:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:11154:x1875173994173184:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305608.192746:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305608.192774:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe083fb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.192938:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.192957:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.192971:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305608.192986:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788305608.193134:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083fb expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.193158:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083fb expref: 23 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.193187:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:3.0:1788305608.193191:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788305608.193195:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305608.193340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:11154:x1875173994173184:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 643us (1147us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788305608.193349:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788305608.196137:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994172928 00000100:00100000:2.0:1788305608.196158:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994172928 00000100:00100000:2.0:1788305608.196268:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305608.196295:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:2398:x1875173994172928:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305608.196317:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305608.196351:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60538bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083f4 expref: 23 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.196378:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:2.0:1788305608.196385:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305608.197251:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2398:x1875173994172928:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 950us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305608.197264:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305608.202971:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.203206:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173312 00000100:00100000:0.0:1788305608.203219:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173312 00000100:00100000:0.0:1788305608.203331:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:0.0:1788305608.203343:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2398:x1875173994173312:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:0.0:1788305608.203404:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.203430:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.203440:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788305608.203463:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305608.203469:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.203516:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.203534:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 7 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305608.203552:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015238272:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305608.203683:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305608.208133:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015238272:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305608.208175:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305608.208948:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.209032:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173440 00000100:00100000:2.0:1788305608.209045:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173440 00002000:00100000:2.0:1788305608.209118:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff889184db6300 x1875173994173440/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:539/0 lens 504/0 e 0 to 0 dl 1788305619 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305608.209129:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db6300 with x1875173994173440 ext(0->12) 00010000:00010000:2.0:1788305608.209139:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.209183:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 8 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305608.209191:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889184db6300 00000100:00100000:2.0:1788305608.209240:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788305608.209252:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994173440:12345-192.168.202.55@tcp:4:lfs.0 00000001:00100000:3.0:1788305608.212252:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000100:00100000:2.0:1788305608.216231:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994173440:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 6969us (7281us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788305608.216247:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:2.0:1788305608.216639:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff889184db6300 x1875173994173440/t4294967300(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:539/0 lens 504/448 e 0 to 0 dl 1788305619 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305608.216651:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db6300 with x1875173994173440 ext(0->12) 00010000:00010000:2.0:1788305608.216662:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.216682:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305608.216690:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889184db6300 00000100:00100000:0.0:1788305608.223101:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.223228:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173568 00000100:00100000:2.0:1788305608.223237:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173568 00010000:00010000:2.0:1788305608.223372:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305608.223560:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788305608.223572:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2397:x1875173994173568:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305608.223599:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788305608.223871:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788305608.223875:0:10341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788305607 00002000:00010000:2.0:1788305608.223877:0:10341:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788305607 00002000:00010000:2.0:1788305608.223879:0:10341:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788305607 00002000:00010000:2.0:1788305608.223881:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788305608.223907:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.223926:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.223958:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6053893 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083df expref: 9 pid: 8436 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.223981:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305608.223986:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305608.223992:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.224003:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.224118:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305608.224328:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2397:x1875173994173568:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 758us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305608.224336:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00010000:00010000:0.0:1788305608.226253:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226346:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226378:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226459:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226467:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226473:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305608.226478:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226487:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226504:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.226512:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e60538e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305608.226742:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb761050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2398:x1875173994173312:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 23397us (23784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305608.226752:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:0.0:1788305608.232970:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305608.235407:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173824 00000100:00100000:1.0:1788305608.235422:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173824 00000100:00100000:3.0:1788305608.235759:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788305608.235773:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11154:x1875173994173824:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:3.0:1788305608.235841:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083fb expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305608.236069:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1788305608.236104:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788305608.238547:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:3.0:1788305608.238604:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.238623:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.238632:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.238671:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.238699:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 26 pid: 6521 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305608.238710:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875174015238400:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305608.238781:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305608.244019:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6522:1875174015238400:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305608.244020:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00010000:00010000:3.0:1788305608.244052:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305608.245763:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994173952 00000100:00100000:2.0:1788305608.245777:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994173952 00010000:00010000:2.0:1788305608.245822:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 27 pid: 6521 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305608.245915:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:2.0:1788305608.245925:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:2396:x1875173994173952:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305608.245941:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305608.245948:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 27 pid: 6521 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.245962:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 27 pid: 6521 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.245994:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6053877 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083d1 expref: 27 pid: 6521 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.246012:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:2.0:1788305608.246017:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.246026:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.246050:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.246082:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305608.246161:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:2396:x1875173994173952:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 237us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305608.246169:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00010000:00010000:3.0:1788305608.246265:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.246292:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305608.246395:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:3.0:1788305608.246565:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:3.0:1788305608.246654:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875174015238528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788305608.246706:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305608.246742:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305608.246938:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015238528 00000100:00100000:1.0:1788305608.246944:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015238528 00000100:00100000:1.0:1788305608.247000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305608.247008:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875174015238528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788305608.247087:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1875174015238528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 81us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305608.247094:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305608.247148:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875174015238528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788305608.247326:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788305608.247373:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875174015238656:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788305608.247411:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305608.247428:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb524780 going to sleep for 11 seconds 00000100:00080000:3.0:1788305608.247527:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305608.248363:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015238656 00000100:00100000:3.0:1788305608.248372:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015238656 00000100:00100000:3.0:1788305608.248429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788305608.248438:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1875174015238656:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788305608.248618:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6522:x1875174015238656:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 180us (1205us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788305608.248632:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788305608.248946:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bf800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6522:1875174015238656:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788305608.249005:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788305608.249045:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249057:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249064:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249070:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305608.249074:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249081:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249096:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:1.0:1788305608.249099:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788305608.249103:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305608.249120:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e60538e7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305608.249223:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788305608.249316:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788305608.249327:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438340051245ns, next at 439340049240ns, rc = 0 00000001:00080000:1.0:1788305608.249341:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788305608.249364:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825bbd00) 00010000:00010000:1.0:1788305608.249368:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305608.249374:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e60538d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083fb expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305608.249470:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:11154:x1875173994173824:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 13701us (16522us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788305608.249478:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000020:00080000:1.0:1788305608.249482:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788305608.256544:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.256757:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994174080 00000100:00100000:2.0:1788305608.256767:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994174080 00000100:00100000:2.0:1788305608.256832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:2.0:1788305608.256842:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:11154:x1875173994174080:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305608.256865:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305608.256888:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60538ee lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08402 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.256952:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60538ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08402 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.256974:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60538ee lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08402 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.256991:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305608.256994:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305608.256998:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305608.257054:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11154:x1875173994174080:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 213us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305608.257061:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788305608.264846:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305608.265131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994174336 00000100:00100000:1.0:1788305608.265151:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994174336 00000100:00100000:1.0:1788305608.265225:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:1.0:1788305608.265237:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11154:x1875173994174336:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788305608.265509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+31:11154:x1875173994174336:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 273us (673us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788305608.265519:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000040:00080000:3.0:1788305608.278393:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788305608.342006:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305608.384041:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.384420:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994174592 00000100:00100000:0.0:1788305608.384435:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994174592 00000100:00100000:0.0:1788305608.385031:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:0.0:1788305608.385044:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+31:11164:x1875173994174592:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305608.385080:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305608.385104:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e60538f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08409 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305608.385249:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788305608.385434:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e60538f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08409 expref: 33 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.385453:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305608.385455:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305608.385459:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e60538f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08409 expref: 33 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.385475:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031c00, rc 0) 00000100:00100000:0.0:1788305608.385544:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11164:x1875173994174592:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 504us (1521us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788305608.385550:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:2.0:1788305608.390217:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.390317:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994174720 00000100:00100000:3.0:1788305608.390331:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994174720 00000100:00100000:3.0:1788305608.390440:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:3.0:1788305608.390453:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11164:x1875173994174720:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788305608.390573:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.390604:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.390618:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.390632:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.390640:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.390647:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391115:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391128:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391156:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305608.391222:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391238:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391246:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391254:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391261:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305608.391267:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391393:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391420:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305608.391424:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305608.391429:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391434:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053903 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391452:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391465:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391472:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391478:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305608.391480:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391487:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391495:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:3.0:1788305608.391498:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305608.391501:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391507:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605390a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391518:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391524:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391530:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391535:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305608.391545:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391551:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391559:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.391562:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305608.391565:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.391570:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305608.391995:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11164:x1875173994174720:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1539us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305608.392007:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:1.0:1788305608.401517:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.404428:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994174976 00000100:00100000:3.0:1788305608.404450:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994174976 00000100:00100000:3.0:1788305608.404538:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305608.404549:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11164:x1875173994174976:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305608.405122:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:11164:x1875173994174976:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 571us (3617us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788305608.405132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788305608.463448:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.463623:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994175232 00000100:00100000:3.0:1788305608.463636:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994175232 00000100:00100000:3.0:1788305608.463714:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:3.0:1788305608.463727:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:11167:x1875173994175232:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305608.463760:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305608.463807:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053918 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08410 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463923:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463940:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463954:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463967:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463974:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.463981:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464127:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464136:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464142:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305608.464166:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788305608.464261:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464332:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464339:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464346:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305608.464351:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464359:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464374:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305608.464377:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305608.464383:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464389:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605391f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464418:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464423:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464428:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464433:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305608.464442:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464448:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464456:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:3.0:1788305608.464458:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305608.464461:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464467:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053926 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053918 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464536:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.464544:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.464546:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305608.464549:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305608.464646:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11167:x1875173994175232:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 922us (1213us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788305608.464656:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:2.0:1788305608.475438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.475551:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994175360 00000100:00100000:0.0:1788305608.475565:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994175360 00000100:00100000:0.0:1788305608.475653:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305608.475666:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11167:x1875173994175360:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305608.475762:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475810:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475824:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475881:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475890:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475899:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475906:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305608.475911:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475918:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475932:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305608.475936:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305608.475942:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.475949:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605393b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305608.476054:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11167:x1875173994175360:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 390us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305608.476069:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:1.0:1788305608.479691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.479806:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994175616 00000100:00100000:2.0:1788305608.479819:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994175616 00000100:00100000:2.0:1788305608.479897:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:2.0:1788305608.479911:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11167:x1875173994175616:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305608.480262:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:11167:x1875173994175616:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 353us (588us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788305608.480272:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:1.0:1788305608.765472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.765883:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994175872 00000100:00100000:3.0:1788305608.765897:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994175872 00000100:00100000:3.0:1788305608.765981:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788305608.765993:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:11198:x1875173994175872:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:3.0:1788305608.766045:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305608.766073:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053942 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08417 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.766507:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053949 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.766530:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.766545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053949 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305608.766561:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788305608.767317:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053942 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08417 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.767344:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053949 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08417 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.767356:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.767359:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305608.767363:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305608.767462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11198:x1875173994175872:12345-192.168.202.55@tcp:101:cat.0 Request processed in 1471us (2006us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788305608.767471:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:0.0:1788305608.772692:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.772885:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.773040:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994176256 00000100:00100000:3.0:1788305608.773054:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994176256 00000100:00100000:3.0:1788305608.773178:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788305608.773213:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:2395:x1875173994176256:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305608.773236:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305608.773270:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053949 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08417 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.773349:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.773356:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305608.773431:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:2395:x1875173994176256:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 222us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305608.773441:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305608.775129:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994176128 00000100:00100000:2.0:1788305608.775158:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994176128 00000100:00100000:2.0:1788305608.775231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788305608.775242:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:11198:x1875173994176128:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:2.0:1788305608.775610:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11198:x1875173994176128:12345-192.168.202.55@tcp:35:cat.0 Request processed in 368us (2934us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788305608.775619:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00010000:00010000:0.0:1788305608.800568:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305608.823878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305608.823999:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994176512 00000100:00100000:2.0:1788305608.824012:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994176512 00000100:00100000:2.0:1788305608.824156:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:2.0:1788305608.824169:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11204:x1875173994176512:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:2.0:1788305608.824206:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305608.824210:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305608.824245:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60538af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ed expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824497:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305608.824503:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305608.824522:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053957 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0841e expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824667:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824684:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824694:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824852:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.824870:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 38 pid: 6520 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305608.824887:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015238784:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305608.825072:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305608.828034:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.828158:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994176640 00000100:00100000:3.0:1788305608.828170:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994176640 00010000:00010000:3.0:1788305608.828229:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 39 pid: 6520 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305608.828324:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:3.0:1788305608.828337:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:2395:x1875173994176640:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305608.828357:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305608.828365:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 39 pid: 6520 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.828383:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 39 pid: 6520 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.828460:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.828466:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.828497:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.828505:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.828528:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305608.828604:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:2395:x1875173994176640:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 269us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305608.828613:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00010000:00010000:2.0:1788305608.829269:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605392d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08410 expref: 38 pid: 6520 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305608.829331:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015238784:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305608.829378:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.829390:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.829397:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305608.829426:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788305608.829643:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053957 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 39 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.829662:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 38 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305608.829670:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305608.829673:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305608.829676:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305608.829740:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11204:x1875173994176512:12345-192.168.202.55@tcp:101:dd.0 Request processed in 5574us (5880us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788305608.829749:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788305608.832224:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305608.832617:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994176768 00000100:00100000:3.0:1788305608.832630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994176768 00000100:00100000:3.0:1788305608.832893:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:3.0:1788305608.832908:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11204:x1875173994176768:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:3.0:1788305608.832942:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305608.832969:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605396c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08425 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833014:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833031:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833045:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833230:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e605396c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833270:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305608.833324:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305608.833327:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305608.833332:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519c00, rc 0) 00000100:00100000:3.0:1788305608.833469:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:11204:x1875173994176768:12345-192.168.202.55@tcp:101:dd.0 Request processed in 565us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305608.833478:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:1.0:1788305608.837962:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305608.838838:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177024 00000100:00100000:0.0:1788305608.838851:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177024 00000100:00100000:0.0:1788305608.839009:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:0.0:1788305608.839019:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:11204:x1875173994177024:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:0.0:1788305608.839418:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.839443:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.839458:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305608.839503:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788305608.839521:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f0d97a8 reply state 0000000015a62db0 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.839592:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305608.839602:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305608.839605:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305608.839610:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305608.839791:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:11204:x1875173994177024:12345-192.168.202.55@tcp:36:dd.0 Request processed in 772us (1846us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788305608.839816:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000020:00080000:0.0:1788305608.839822:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788305609.220429:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305609.220500:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177152 00000100:00100000:3.0:1788305609.220516:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177152 00000100:00100000:3.0:1788305609.220686:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:3.0:1788305609.220704:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:11218:x1875173994177152:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:3.0:1788305609.220741:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305609.220771:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053981 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0842c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220861:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220879:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220896:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220910:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220939:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.220947:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.221045:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.221057:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.221067:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788305609.221108:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305609.221901:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.221926:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 43 pid: 10615 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305609.221945:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015238912:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305609.222205:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305609.226441:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf938e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015238912:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305609.226496:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305609.230821:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305609.231396:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177408 00000100:00100000:1.0:1788305609.231410:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177408 00000100:00100000:1.0:1788305609.231486:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305609.231499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+44:6168:x1875173994177408:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788305609.231974:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+45:6168:x1875173994177408:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 474us (1170us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788305609.231983:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305609.235805:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.235962:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177536 00000100:00100000:2.0:1788305609.235975:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177536 00010000:00010000:2.0:1788305609.236031:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 45 pid: 10615 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305609.236170:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788305609.236183:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+45:2396:x1875173994177536:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305609.236212:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305609.236741:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 45 pid: 10615 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236759:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 45 pid: 10615 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236786:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605395e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0841e expref: 45 pid: 10615 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236806:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.236811:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236823:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236831:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.236880:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305609.236946:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+44:2396:x1875173994177536:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 764us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305609.236955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00010000:00010000:0.0:1788305609.237030:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237040:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305609.237120:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788305609.237126:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305609.237183:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237200:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237212:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237219:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237226:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237233:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305609.237238:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237247:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237316:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305609.237320:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305609.237324:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237331:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053988 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237344:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237352:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237358:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237363:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305609.237365:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237371:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237380:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:0.0:1788305609.237383:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305609.237386:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237392:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605398f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237442:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0842c expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237458:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0842c expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.237466:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.237469:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305609.237471:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:0.0:1788305609.237503:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:11218:x1875173994177152:12345-192.168.202.55@tcp:101:stat.0 Request processed in 16806us (17090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305609.237511:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:2.0:1788305609.370550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.370695:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177792 00000100:00100000:0.0:1788305609.370705:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177792 00000100:00100000:0.0:1788305609.370784:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:0.0:1788305609.370804:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:11224:x1875173994177792:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:0.0:1788305609.370864:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305609.370893:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053996 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0842c expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.370913:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.370919:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305609.371091:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.371119:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.371138:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305609.371185:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788305609.371210:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040b015a2 reply state 00000000358ee4dc transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.371222:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.371229:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.371231:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305609.371234:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305609.371407:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+45:11224:x1875173994177792:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 603us (866us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788305609.371415:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000020:00080000:0.0:1788305609.371421:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788305609.507470:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.507591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994177920 00000100:00100000:2.0:1788305609.507600:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994177920 00000100:00100000:2.0:1788305609.507660:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788305609.507671:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+45:11238:x1875173994177920:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:2.0:1788305609.507697:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305609.507716:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08433 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507778:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507790:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507801:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507811:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507817:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507823:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507933:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507943:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.507969:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305609.508018:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788305609.508022:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305609.508052:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508065:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508073:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508078:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508084:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508089:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.508093:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508110:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508121:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305609.508124:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.508128:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e60539ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508157:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508163:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508170:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508174:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.508177:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508183:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508189:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:2.0:1788305609.508191:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.508194:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508199:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508225:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508237:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.508250:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.508252:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305609.508254:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305609.508384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:11238:x1875173994177920:12345-192.168.202.55@tcp:101:stat.0 Request processed in 714us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305609.508393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:1.0:1788305609.614141:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.614251:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994178176 00000100:00100000:0.0:1788305609.614262:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994178176 00000100:00100000:0.0:1788305609.614362:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788305609.614373:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:11248:x1875173994178176:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305609.614394:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305609.614435:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60539c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0843a expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305609.614539:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788305609.614652:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60539c0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0843a expref: 48 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.614674:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305609.614678:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305609.614684:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60539c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0843a expref: 48 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.614699:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9600, rc 0) 00000100:00100000:0.0:1788305609.614769:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:11248:x1875173994178176:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 398us (637us total) trans 4294967341 rc 301/301 00000100:00100000:0.0:1788305609.614777:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:1.0:1788305609.625334:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.625423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994178432 00000100:00100000:2.0:1788305609.625436:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994178432 00000100:00100000:2.0:1788305609.625514:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788305609.625525:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:11248:x1875173994178432:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305609.625781:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:11248:x1875173994178432:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 256us (457us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788305609.625789:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305609.703371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.703456:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994178688 00000100:00100000:2.0:1788305609.703466:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994178688 00000100:00100000:2.0:1788305609.704348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:2.0:1788305609.704364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:11254:x1875173994178688:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305609.704388:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305609.704406:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08441 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.704511:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.704537:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.704560:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.704940:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 49 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.704955:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 49 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305609.704969:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015239040:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305609.705069:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff889188508a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305609.716373:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015239040:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305609.716403:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305609.716803:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.717247:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994178816 00000100:00100000:0.0:1788305609.717256:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994178816 00010000:00010000:0.0:1788305609.717338:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 50 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305609.717374:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788305609.717384:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:2395:x1875173994178816:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305609.717399:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305609.717405:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 50 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717418:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 50 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717441:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e60539b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08433 expref: 50 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717479:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.717484:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717493:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717500:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.717537:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305609.717607:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:2395:x1875173994178816:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 224us (806us total) trans 0 rc 0/0 00010000:00010000:2.0:1788305609.717855:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.717872:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305609.717892:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788305609.718038:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.718055:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.718075:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.718078:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305609.718081:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305609.718125:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:11254:x1875173994178688:12345-192.168.202.55@tcp:101:bash.0 Request processed in 13766us (14763us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788305609.718133:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788305609.718244:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:1.0:1788305609.721146:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.721323:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179072 00000100:00100000:0.0:1788305609.721333:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179072 00000100:00100000:0.0:1788305609.721392:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:0.0:1788305609.721402:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:11254:x1875173994179072:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:1.0:1788305609.721985:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305609.722006:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305609.722018:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305609.722065:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788305609.722087:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a41da5a2 reply state 00000000ec858cc2 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305609.722111:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305609.722118:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:1.0:1788305609.722121:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305609.722125:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305609.722232:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:11254:x1875173994179072:12345-192.168.202.55@tcp:36:bash.0 Request processed in 830us (1095us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788305609.722250:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000020:00080000:1.0:1788305609.722255:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305609.729379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.729483:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179200 00000100:00100000:0.0:1788305609.729494:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179200 00000100:00100000:0.0:1788305609.729581:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:0.0:1788305609.729592:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:11254:x1875173994179200:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305609.729829:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305609.729852:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60539ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08448 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.729942:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.729963:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.729972:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.730005:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.730018:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 53 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305609.730033:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015239168:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305609.730120:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305609.733084:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015239168:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305609.733147:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305609.733375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305609.736077:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179328 00000100:00100000:3.0:1788305609.736102:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179328 00010000:00010000:3.0:1788305609.736160:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 54 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305609.736216:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:3.0:1788305609.736226:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:2396:x1875173994179328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305609.736242:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305609.736249:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 54 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736261:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 54 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736433:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e60539d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08441 expref: 54 pid: 6520 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736451:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305609.736456:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736466:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736473:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305609.736556:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305609.736632:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:2396:x1875173994179328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 406us (3260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305609.736639:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00010000:00010000:0.0:1788305609.742395:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.742417:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305609.742485:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788305609.742489:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305609.742516:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.744329:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60539ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08448 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.744358:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08448 expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.744386:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.744389:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305609.744393:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9200, rc 0) 00000100:00100000:0.0:1788305609.744479:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:11254:x1875173994179200:12345-192.168.202.55@tcp:101:bash.0 Request processed in 14886us (15107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305609.744487:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:1.0:1788305609.749450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.749538:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179584 00000100:00100000:2.0:1788305609.749549:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179584 00000100:00100000:2.0:1788305609.749621:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788305609.749631:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:11254:x1875173994179584:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:2.0:1788305609.749852:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11254:x1875173994179584:12345-192.168.202.55@tcp:35:bash.0 Request processed in 221us (411us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788305609.749870:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:0.0:1788305609.815477:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305609.850456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.850854:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179840 00000100:00100000:2.0:1788305609.850868:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179840 00000100:00100000:2.0:1788305609.850946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:2.0:1788305609.850956:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11264:x1875173994179840:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305609.850980:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305609.851001:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0844f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305609.851114:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788305609.851207:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539f8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0844f expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.851241:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:2.0:1788305609.851244:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305609.851249:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e60539f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0844f expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.851264:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305609.851383:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11264:x1875173994179840:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 428us (1220us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788305609.851391:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:1.0:1788305609.855827:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.856089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994179968 00000100:00100000:2.0:1788305609.856109:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994179968 00000100:00100000:2.0:1788305609.856177:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:2.0:1788305609.856188:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11264:x1875173994179968:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788305609.856302:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856320:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856332:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856345:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856352:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856382:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856456:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856466:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856472:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305609.856526:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856539:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856545:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856551:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856558:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.856562:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856569:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856581:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305609.856590:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.856596:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.856601:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858350:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858364:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858372:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858378:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.858382:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858389:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858404:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:2.0:1788305609.858407:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.858410:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858416:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858432:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858452:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858458:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858463:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.858466:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858471:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858480:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.858482:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.858485:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.858490:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305609.858595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11264:x1875173994179968:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 2405us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305609.858606:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:0.0:1788305609.877654:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.877740:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994180224 00000100:00100000:2.0:1788305609.877751:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994180224 00000100:00100000:2.0:1788305609.877814:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305609.877825:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11264:x1875173994180224:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305609.878073:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:11264:x1875173994180224:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 249us (429us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788305609.878104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:1.0:1788305609.921561:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.921710:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994180480 00000100:00100000:2.0:1788305609.921721:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994180480 00000100:00100000:2.0:1788305609.921814:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:2.0:1788305609.921826:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:11268:x1875173994180480:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305609.921852:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305609.921871:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08456 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.921966:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.921981:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.921995:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922007:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922031:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922038:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922156:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922177:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922184:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305609.922196:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788305609.922272:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922324:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922331:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922336:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.922341:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922348:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922360:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305609.922363:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.922368:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922375:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922387:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922400:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922405:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922410:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305609.922413:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922418:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922426:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:2.0:1788305609.922429:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305609.922432:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922437:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053a29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922471:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08456 expref: 58 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922483:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08456 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.922489:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.922491:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305609.922498:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305609.922556:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:11268:x1875173994180480:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 732us (1005us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788305609.922565:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:1.0:1788305609.927008:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305609.927155:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994180608 00000100:00100000:0.0:1788305609.927166:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994180608 00000100:00100000:0.0:1788305609.927234:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788305609.927245:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:11268:x1875173994180608:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305609.927526:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927775:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927788:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927829:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927835:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927842:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927862:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305609.927866:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927874:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927886:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305609.927890:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305609.927895:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305609.927901:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053a3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305609.928035:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:11268:x1875173994180608:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 790us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305609.928045:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788305609.931518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.931635:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994180736 00000100:00100000:2.0:1788305609.931645:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994180736 00000100:00100000:2.0:1788305609.931773:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788305609.931785:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:2395:x1875173994180736:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305609.931803:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305609.931831:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08456 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305609.931853:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305609.931870:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305609.931932:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:2395:x1875173994180736:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 149us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305609.931940:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305609.935522:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305609.935616:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994180992 00000100:00100000:2.0:1788305609.935627:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994180992 00000100:00100000:2.0:1788305609.935691:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788305609.935703:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:11268:x1875173994180992:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305609.935929:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:11268:x1875173994180992:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 229us (418us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788305609.935937:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305610.150404:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305610.150539:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994181248 00000100:00100000:1.0:1788305610.150550:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994181248 00000100:00100000:1.0:1788305610.150678:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788305610.150702:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:11286:x1875173994181248:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:1.0:1788305610.150735:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305610.150756:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053a45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0845d expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.150873:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053a4c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.150890:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053a4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.150901:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053a4c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305610.150911:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788305610.151038:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053a45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0845d expref: 60 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.151077:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053a4c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0845d expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.151087:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:1.0:1788305610.151121:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788305610.151125:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305610.151193:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11286:x1875173994181248:12345-192.168.202.55@tcp:101:cat.0 Request processed in 504us (801us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788305610.151200:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788305610.196385:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.196604:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994181376 00000100:00100000:2.0:1788305610.196616:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994181376 00000100:00100000:2.0:1788305610.196680:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00000100:00100000:2.0:1788305610.196707:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11287:x1875173994181376:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305610.196736:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305610.196756:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08464 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.196824:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.196839:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.196864:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305610.196911:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788305610.196915:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305610.196946:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.196975:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08464 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.196993:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08464 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.197002:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305610.197005:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305610.197009:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea800, rc 0) 00000100:00100000:2.0:1788305610.197080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11287:x1875173994181376:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 374us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.197108:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00000004:00080000:0.0:1788305610.197429:0:9966:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440288151907ns, next at 441288148979ns, rc = 0 00000100:00100000:2.0:1788305610.197669:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305610.197688:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015239296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305610.197750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305610.197816:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239296 00000100:00100000:2.0:1788305610.197822:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239296 00000100:00100000:2.0:1788305610.197863:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788305610.197871:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015239296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305610.197894:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00080000:1.0:1788305610.198312:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305610.198333:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015239424:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305610.198364:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.198412:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015239296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305610.198445:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239424 00000100:00100000:1.0:1788305610.198450:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239424 00000100:00100000:1.0:1788305610.198474:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788305610.198481:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015239424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305610.198497:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305610.198533:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015239424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.198540:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788305610.198557:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305610.198575:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015239424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305610.199164:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305610.199175:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305610.199211:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305610.199253:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239552 00000100:00100000:0.0:1788305610.199257:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239552 00000100:00100000:0.0:1788305610.199309:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788305610.199316:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015239552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305610.199340:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305610.199377:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015239552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.199383:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1788305610.199401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305610.199422:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015239552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305610.200087:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015239296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.200108:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788305610.200354:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015239936:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200413:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015240448:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200435:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200459:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015240960:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200487:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200508:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788305610.200514:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015239808:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200554:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015240320:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200585:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200604:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015240832:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200625:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.200651:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240320 00000100:00100000:1.0:1788305610.200656:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240320 00000100:00100000:1.0:1788305610.200688:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788305610.200695:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015240320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200739:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015240320:12345-0@lo:400:kworker.0 Request processed in 43us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.200745:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788305610.200775:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015240320:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200797:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239936 00000100:00100000:1.0:1788305610.200800:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239936 00000100:00100000:1.0:1788305610.200822:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240448 00000100:00100000:1.0:1788305610.200824:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240448 00000100:00100000:1.0:1788305610.200866:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240832 00000100:00100000:1.0:1788305610.200870:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240832 00000100:00100000:1.0:1788305610.200883:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788305610.200889:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015239936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200923:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015239936:12345-0@lo:400:kworker.0 Request processed in 35us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.200929:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788305610.200961:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015239936:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.200978:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788305610.200984:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015240448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.201017:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015240448:12345-0@lo:400:kworker.0 Request processed in 34us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.201023:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788305610.201044:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015240448:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.201062:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788305610.201068:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015240832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.201110:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015240832:12345-0@lo:400:kworker.0 Request processed in 43us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.201116:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00080000:1.0:1788305610.201139:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfa55f80 x1875174015240832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305610.201149:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015240832:0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.201460:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240960 00000100:00100000:2.0:1788305610.201465:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240960 00000100:00100000:2.0:1788305610.201495:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305610.201502:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015240960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.201541:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015240960:12345-0@lo:400:kworker.0 Request processed in 40us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.201547:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305610.201564:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239808 00000100:00100000:2.0:1788305610.201567:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239808 00000100:00100000:2.0:1788305610.201589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788305610.201595:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015239808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.201625:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af19ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015239808:12345-0@lo:400:kworker.0 Request processed in 30us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.201631:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788305610.202189:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015240064:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305610.202266:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015240576:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305610.202342:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305610.202350:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015239680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305610.202377:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305610.202397:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015240192:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305610.202437:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015240704:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202459:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305610.202483:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240064 00000100:00100000:3.0:1788305610.202488:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240064 00000100:00100000:3.0:1788305610.202520:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788305610.202527:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015240064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202566:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015240064:12345-0@lo:400:kworker.0 Request processed in 39us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.202585:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788305610.202607:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015239680 00000100:00100000:3.0:1788305610.202611:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015239680 00000100:00100000:3.0:1788305610.202635:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788305610.202651:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015239680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305610.202667:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788305610.202699:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015239680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.202705:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788305610.202744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015239680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305610.202754:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015240064:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202781:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240576 00000100:00100000:3.0:1788305610.202784:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240576 00000100:00100000:3.0:1788305610.202806:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240192 00000100:00100000:3.0:1788305610.202808:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240192 00000100:00100000:3.0:1788305610.202819:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015240704 00000100:00100000:3.0:1788305610.202821:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015240704 00000100:00100000:3.0:1788305610.202834:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788305610.202840:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015240576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.202889:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015240576:12345-0@lo:400:kworker.0 Request processed in 49us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.202895:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00080000:3.0:1788305610.202921:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083e67480 x1875174015240576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305610.202931:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015240576:0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.203496:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.203522:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994181760 00000100:00100000:2.0:1788305610.203526:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994181760 00000100:00100000:2.0:1788305610.203561:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788305610.203583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11287:x1875173994181760:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305610.203846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11287:x1875173994181760:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 264us (352us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788305610.203864:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:2.0:1788305610.203889:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788305610.203897:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015240192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.203933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015240192:12345-0@lo:400:kworker.0 Request processed in 37us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.203950:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788305610.203964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788305610.203971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015240704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305610.203998:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015240704:12345-0@lo:400:kworker.0 Request processed in 28us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.204003:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:0.0:1788305610.204256:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305610.204262:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305610.204264:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305610.207593:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015239808:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.207621:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015240960:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.207878:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015240192:0@lo:400:kworker.0 00000100:00100000:3.0:1788305610.207893:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015240704:0@lo:400:kworker.0 00000100:00100000:1.0:1788305610.216189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305610.216339:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994181888 00000100:00100000:0.0:1788305610.216351:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994181888 00000100:00100000:0.0:1788305610.216421:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305610.216432:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11287:x1875173994181888:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:0.0:1788305610.216448:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788305610.216475:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60539f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08448 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.216500:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053a4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0845d expref: 60 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.216512:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e60538ee lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08402 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.216523:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305610.216527:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305610.216587:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11287:x1875173994181888:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 156us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.216612:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788305610.227585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.227920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182016 00000100:00100000:3.0:1788305610.227932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182016 00000100:00100000:3.0:1788305610.228008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:3.0:1788305610.228020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11287:x1875173994182016:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:3.0:1788305610.228164:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.228183:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.228196:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305610.228498:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305610.228927:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788305610.229020:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788305610.229122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11287:x1875173994182016:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 1102us (1559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.229132:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:1.0:1788305610.264082:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.267075:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182144 00000100:00100000:2.0:1788305610.267125:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182144 00000100:00100000:2.0:1788305610.267205:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:2.0:1788305610.267216:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11289:x1875173994182144:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305610.267248:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305610.267269:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a6f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0846b expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267384:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267398:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267409:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267420:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267427:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267433:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267513:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267523:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267530:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305610.267588:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788305610.267594:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305610.267613:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267637:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267646:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267653:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267660:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267666:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.267671:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267679:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267709:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305610.267713:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.267718:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267725:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a76 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267740:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267746:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267758:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267764:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.267767:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267774:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267782:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:2.0:1788305610.267785:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.267788:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267793:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267824:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a6f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 60 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267837:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.267845:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.267847:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305610.267850:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305610.267917:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11289:x1875173994182144:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 702us (3843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.267933:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00000040:00080000:3.0:1788305610.325555:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305610.325568:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305610.325622:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788305610.325633:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305610.325802:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015241088:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305610.325927:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305610.330792:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015241088:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305610.334999:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.335136:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182272 00000100:00100000:3.0:1788305610.335147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182272 00000100:00100000:3.0:1788305610.335318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788305610.335386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11296:x1875173994182272:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305610.335442:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305610.336122:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11296:x1875173994182272:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 736us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.336131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:1.0:1788305610.341691:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.341806:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182400 00000100:00100000:2.0:1788305610.341816:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182400 00000100:00100000:2.0:1788305610.341933:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:2.0:1788305610.341945:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11296:x1875173994182400:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.342035:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342053:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342065:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342111:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342119:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342126:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342153:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342163:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342169:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305610.342239:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788305610.342243:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305610.342259:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342270:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342313:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342329:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342336:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.342340:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342348:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342362:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:2.0:1788305610.342365:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.342371:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342377:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053a8b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342393:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342409:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342416:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342421:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.342424:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342430:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342438:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff88908362ef00) 00010000:00010000:2.0:1788305610.342441:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.342444:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342450:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053a92 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342465:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342470:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342489:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342495:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.342503:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342510:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342518:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.342521:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.342524:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.342529:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053a99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.342619:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11296:x1875173994182400:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 676us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.342627:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:1.0:1788305610.348542:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.348701:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182656 00000100:00100000:2.0:1788305610.348711:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182656 00000100:00100000:2.0:1788305610.348765:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:2.0:1788305610.348775:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11296:x1875173994182656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.348798:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305610.348819:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053aa0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08472 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.348936:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.348950:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.348988:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305610.349000:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788305610.349103:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349111:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349118:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349124:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.349128:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349136:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349148:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.349150:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305610.349154:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349160:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053aa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349202:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053aa0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08472 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349223:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:2.0:1788305610.349226:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305610.349230:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053aa0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08472 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.349240:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305610.349334:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11296:x1875173994182656:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 561us (801us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788305610.349341:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000001:00080000:0.0:1788305610.353150:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1788305610.353170:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1788305610.353227:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788305610.353238:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8891863e50c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788305610.353243:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88918cab4700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8891863e5d80 00000020:00080000:0.0:1788305610.353246:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff88918cab4300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889183276a00 00000020:00080000:3.0:1788305610.353354:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788305610.353516:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788305610.354204:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.354256:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994182784 00000100:00100000:3.0:1788305610.354266:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994182784 00000100:00100000:3.0:1788305610.354350:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788305610.354361:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+31:11296:x1875173994182784:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305610.354396:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305610.354495:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+31:11296:x1875173994182784:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 136us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.354503:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:2.0:1788305610.354801:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305610.354816:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015241216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788305610.354866:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305610.354902:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015241216 00000100:00100000:2.0:1788305610.354906:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015241216 00000100:00100000:2.0:1788305610.354933:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305610.354939:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015241216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788305610.354957:0:8758:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788305610.355155:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9760c7, atime: 0x6a9760c7, ctime: 0x6a9760c7, blocks: 0x8 00010000:00010000:2.0:1788305610.355165:0:8758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355182:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788305610.355187:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305610.355194:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355226:0:8758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355237:0:8758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355245:0:8758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355263:0:8758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788305610.355394:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015241216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 455us (527us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788305610.355401:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788305610.355421:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305610.355427:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355435:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305610.355440:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355449:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355466:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355479:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3b5544d/0x4a426866e6053ab5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.355497:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305610.355498:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305610.355500:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788305610.355525:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8890836d4a80/2, rc 0, transno 4294967302 00000100:00100000:2.0:1788305610.355530:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015241216:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788305610.355958:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.355967:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.355974:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.355988:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.355992:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.355998:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356010:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8890825bbf00) 00010000:00010000:1.0:1788305610.356013:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356016:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356022:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e605382a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356038:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356055:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356061:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356066:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.356069:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356075:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356082:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305610.356084:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356095:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356102:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053831 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356116:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356121:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356126:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356131:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180030a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.356140:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356146:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356154:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825bba00) 00010000:00010000:1.0:1788305610.356157:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356160:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356165:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6053870 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356183:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356190:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356195:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356200:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.356202:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356207:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356214:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:1.0:1788305610.356217:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356235:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356242:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e605397a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356255:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356261:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356266:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356270:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.356299:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356306:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356313:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:1.0:1788305610.356316:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356323:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356329:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e605399d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356340:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356346:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356358:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356363:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305610.356366:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356371:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356380:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:1.0:1788305610.356383:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305610.356385:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.356392:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60539e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305610.369513:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.369745:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183040 00000100:00100000:2.0:1788305610.369757:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183040 00000100:00100000:2.0:1788305610.369820:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:2.0:1788305610.369830:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:11296:x1875173994183040:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.369954:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305610.369958:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305610.370062:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053a61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08464 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.370082:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305610.370086:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305610.370109:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053abc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08479 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305610.376437:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788305610.384230:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.384254:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.384265:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.384355:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053abc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08479 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.384375:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08479 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.384384:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b2600) 00010000:00010000:0.0:1788305610.384387:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305610.384390:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305610.384452:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11296:x1875173994183040:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 14622us (14947us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788305610.384476:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:3.0:1788305610.394109:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305610.395833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183296 00000100:00100000:0.0:1788305610.395851:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183296 00000100:00100000:0.0:1788305610.395935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:0.0:1788305610.395947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11296:x1875173994183296:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788305610.396019:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305610.396046:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08479 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396068:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b2600) 00010000:00010000:0.0:1788305610.396079:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305610.396113:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396127:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396135:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396149:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396154:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396160:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396217:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396224:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396230:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396235:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305610.396239:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396247:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396256:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305610.396259:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305610.396262:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396267:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053ad1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396303:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396310:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396316:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396327:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305610.396330:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396336:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396345:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfffd9f41 (ffff8890825b2200) 00010000:00010000:0.0:1788305610.396347:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305610.396350:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.396354:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053ad8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfffd9f41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.396452:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:11296:x1875173994183296:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 506us (2372us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305610.396460:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:3.0:1788305610.398608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.398679:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183424 00000100:00100000:3.0:1788305610.398692:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183424 00000100:00100000:3.0:1788305610.399118:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788305610.399133:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:11296:x1875173994183424:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305610.399224:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305610.399261:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053adf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08480 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399342:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399390:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399561:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053adf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399651:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.399660:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.399663:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305610.399667:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305610.399751:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11296:x1875173994183424:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 621us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.399760:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788305610.402455:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.402506:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183680 00000100:00100000:3.0:1788305610.402518:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183680 00000100:00100000:3.0:1788305610.402608:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:3.0:1788305610.402621:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11296:x1875173994183680:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305610.402734:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.402758:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.402792:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305610.403108:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788305610.403123:0:10615:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440493846389ns, next at 441493842619ns, rc = 0 00000004:00010000:3.0:1788305610.403199:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6fa8fcf reply state 00000000140e5587 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.403215:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.403225:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.403228:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788305610.403234:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305610.403412:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11296:x1875173994183680:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 791us (969us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788305610.403421:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:0.0:1788305610.408265:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.408437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183808 00000100:00100000:3.0:1788305610.408451:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183808 00000100:00100000:3.0:1788305610.408578:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:3.0:1788305610.408592:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11296:x1875173994183808:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305610.408628:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305610.408657:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08487 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.408736:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.408778:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.408804:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.408818:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305610.408824:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305610.409031:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11296:x1875173994183808:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 440us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.409040:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:3.0:1788305610.412827:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305610.412984:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994183936 00000100:00100000:0.0:1788305610.412997:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994183936 00000100:00100000:0.0:1788305610.413056:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788305610.413066:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2394:x1875173994183936:12345-192.168.202.55@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788305610.413122:0:8435:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:0.0:1788305610.413169:0:8435:0:(genops.c:1385:class_connect()) connect: client 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891, cookie 0x4a426866e6053afb 00002000:00100000:0.0:1788305610.413186:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891/ffff889083e7b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305610.413202:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305610.413368:0:8435:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788305610.413421:0:8435:0:(import.c:65:import_set_state_nolock()) ffff889183844000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305610.413783:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2394:x1875173994183936:12345-192.168.202.55@tcp:8:lhsmtool_posix.0 Request processed in 714us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.413794:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788305610.416820:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.416957:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994184064 00000100:00100000:3.0:1788305610.416971:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994184064 00000100:00100000:3.0:1788305610.417076:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788305610.417099:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:0:x1875173994184064:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788305610.417793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788305610.426243:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:1.0:1788305610.426258:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000100:00100000:3.0:1788305610.426566:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:0:x1875173994184064:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 9472us (9754us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788305610.426578:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:2.0:1788305610.434592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.435718:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994184320 00000100:00100000:3.0:1788305610.435731:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994184320 00000100:00100000:3.0:1788305610.435794:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:3.0:1788305610.435806:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11296:x1875173994184320:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305610.436038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11296:x1875173994184320:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 234us (1470us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788305610.436045:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:1.0:1788305610.441879:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.441966:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994184576 00000100:00100000:2.0:1788305610.441976:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994184576 00000100:00100000:2.0:1788305610.442037:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:2.0:1788305610.442056:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11296:x1875173994184576:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788305610.442194:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11296:x1875173994184576:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.442202:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:0.0:1788305610.451374:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305610.451741:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994184704 00000100:00100000:1.0:1788305610.451752:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994184704 00000100:00100000:1.0:1788305610.451812:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788305610.451823:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11296:x1875173994184704:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305610.451843:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305610.451871:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053b02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0848e expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.451941:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.451955:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.451966:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305610.452013:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305610.452036:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.452063:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053b02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0848e expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.452080:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0848e expref: 18 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.452099:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:1.0:1788305610.452102:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788305610.452106:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50e00, rc 0) 00000100:00100000:1.0:1788305610.452176:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11296:x1875173994184704:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 355us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.452183:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:0.0:1788305610.461924:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305610.462457:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994184832 00000100:00100000:1.0:1788305610.462469:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994184832 00000100:00100000:0.0:1788305610.462633:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:0.0:1788305610.462644:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994184832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305610.462663:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305610.462684:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08495 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305610.462711:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9760ca, blocks: 0x0 00010000:00010000:0.0:1788305610.462730:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788305610.462735:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305610.462744:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.462764:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 6 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.462780:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305610.462840:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994184832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 198us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.462857:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:1.0:1788305610.467256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.467452:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185088 00000100:00100000:3.0:1788305610.467463:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185088 00000100:00100000:3.0:1788305610.467526:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:3.0:1788305610.467537:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11296:x1875173994185088:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305610.467664:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11296:x1875173994185088:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 129us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.467672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:1.0:1788305610.486751:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.486921:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185216 00000100:00100000:2.0:1788305610.486932:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185216 00000100:00100000:2.0:1788305610.486995:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788305610.487007:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:11296:x1875173994185216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.487027:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305610.487046:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0849c expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.487084:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.487105:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305610.487110:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305610.487115:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.487151:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.487165:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.487200:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015241344:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305610.487313:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305610.492053:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.492158:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015241344:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305610.492194:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.492216:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b800, rc 0) 00000100:00100000:2.0:1788305610.492293:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11296:x1875173994185216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 5272us (5533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.492302:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:3.0:1788305610.492839:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185344 00000100:00100000:3.0:1788305610.492867:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185344 00010000:00010000:3.0:1788305610.492939:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.493004:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788305610.493020:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994185344:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305610.493041:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305610.493072:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.493099:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.493136:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082f0230e/0x4a426866e6053b10 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08495 expref: 7 pid: 8436 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.493167:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305610.493174:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305610.493200:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.493212:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.493264:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 6 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.493305:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1875174015241472:192.168.202.55@tcp:105: 00000100:00100000:3.0:1788305610.493412:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305610.501454:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.501600:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903ff800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1875174015241472:192.168.202.55@tcp:105: 00010000:00010000:3.0:1788305610.501636:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305610.501724:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994185344:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 8708us (9680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.501738:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:2.0:1788305610.501871:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185472 00000100:00100000:2.0:1788305610.501882:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185472 00002000:00100000:2.0:1788305610.502007:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff889184db4a80 x1875173994185472/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:541/0 lens 504/0 e 0 to 0 dl 1788305621 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305610.502018:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db4a80 with x1875173994185472 ext(0->8) 00002000:00010000:2.0:1788305610.502024:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889184db4a80 00000100:00100000:2.0:1788305610.502112:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:2.0:1788305610.502123:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994185472:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788305610.504692:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994185472:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 2553us (3232us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788305610.504710:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:2.0:1788305610.504726:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff889184db4a80 x1875173994185472/t4294967303(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:541/0 lens 504/448 e 0 to 0 dl 1788305621 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305610.504750:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db4a80 with x1875173994185472 ext(0->8) 00002000:00010000:2.0:1788305610.504758:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889184db4a80 00000100:00100000:0.0:1788305610.507636:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305610.507718:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185600 00000100:00100000:1.0:1788305610.507735:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185600 00000100:00100000:1.0:1788305610.507815:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:1.0:1788305610.507827:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11296:x1875173994185600:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788305610.510871:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:1.0:1788305610.510887:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1788305610.510933:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.510952:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.510961:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.510969:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305610.510974:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.511002:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788305610.511022:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1788305610.511025:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.511031:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305610.511037:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.511044:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053aed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788305610.511159:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788305610.511173:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788305610.511200:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015241600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788305610.516372:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:11296:x1875173994185600:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 8531us (8738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305610.516396:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:3.0:1788305610.524439:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305610.524675:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015241600 00000100:00100000:2.0:1788305610.524691:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015241600 00000100:00100000:2.0:1788305610.524757:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788305610.524770:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015241600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305610.525071:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305610.525115:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185728 00000100:00100000:0.0:1788305610.525120:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185728 00000100:00100000:0.0:1788305610.525150:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:0.0:1788305610.525157:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994185728:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00002000:00010000:2.0:1788305610.526809:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788305610.526821:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788305610 00002000:00010000:2.0:1788305610.526824:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788305610.526826:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788305610 -> 1788305610 00002000:00010000:2.0:1788305610.526829:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788305610.528157:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015241600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3375us (3719us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788305610.528174:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:3.0:1788305610.528392:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88918caa8700/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788305610.528401:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015241600:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1788305610.529551:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788305610.530236:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994185728:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 5070us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.530250:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:0.0:1788305610.533705:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.533835:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994185984 00000100:00100000:3.0:1788305610.533848:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994185984 00000100:00100000:3.0:1788305610.533946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:3.0:1788305610.533959:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:11296:x1875173994185984:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305610.534070:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305610.534120:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053b09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0848e expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.534147:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.534154:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305610.534201:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.534227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.534239:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305610.534454:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d28fa696 reply state 00000000b36e5160 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.534468:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.534474:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.534477:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305610.534480:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305610.534632:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11296:x1875173994185984:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 672us (939us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788305610.534640:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:0.0:1788305610.537491:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.537577:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994186112 00000100:00100000:3.0:1788305610.537590:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994186112 00000100:00100000:3.0:1788305610.537654:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:3.0:1788305610.537664:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994186112:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788305610.537843:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788305610.537856:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788305610 -> 1788305609 00002000:00010000:3.0:1788305610.537859:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788305607 00002000:00010000:3.0:1788305610.537862:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788305610 -> 1788305609 00002000:00010000:3.0:1788305610.537865:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788305610.538146:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994186112:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 482us (665us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788305610.538174:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:0.0:1788305610.542460:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.542592:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994186368 00000100:00100000:2.0:1788305610.542609:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994186368 00000100:00100000:2.0:1788305610.542695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:2.0:1788305610.542710:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:11296:x1875173994186368:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.542816:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.542838:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.542859:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.543140:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.543167:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.543190:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015241728:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305610.543329:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305610.547390:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.547529:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015241728:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305610.547579:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.547704:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994186496 00000100:00100000:3.0:1788305610.547713:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994186496 00010000:00010000:3.0:1788305610.547766:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 16 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.547811:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:3.0:1788305610.547822:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:2396:x1875173994186496:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305610.547844:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305610.547862:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 16 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.547876:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 16 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.547903:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053ae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08480 expref: 16 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.547931:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:3.0:1788305610.547936:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.547947:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.547955:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.548005:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305610.548076:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:2396:x1875173994186496:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 255us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.548084:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00010000:00010000:2.0:1788305610.548313:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548321:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548375:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548384:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548391:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548399:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.548404:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548422:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548435:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:2.0:1788305610.548437:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788305610.548442:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.548448:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b25 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.548498:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:11296:x1875173994186368:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 5792us (6056us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788305610.548507:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:0.0:1788305610.552048:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.552141:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994186624 00000100:00100000:2.0:1788305610.552156:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994186624 00000100:00100000:2.0:1788305610.552229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788305610.552241:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994186624:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788305610.552346:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.552373:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.552383:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305610.552388:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305610.552393:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.552460:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.552477:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 7 pid: 8437 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.552495:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015241856:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305610.552626:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305610.555555:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015241856:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305610.555605:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.557985:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305610.558837:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994186752 00000100:00100000:2.0:1788305610.558851:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994186752 00010000:00010000:2.0:1788305610.558900:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 8 pid: 8437 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.558953:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788305610.558964:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994186752:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305610.558980:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305610.559001:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 8 pid: 8437 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.559016:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 8 pid: 8437 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.559058:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f55b4cc9/0x4a426866e6053b17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0849c expref: 8 pid: 8437 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.559075:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305610.559079:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305610.559097:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.559107:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.559146:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305610.559218:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994186752:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 255us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.559227:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00010000:00010000:3.0:1788305610.559236:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559253:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559311:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559322:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559332:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559339:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305610.559344:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559353:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559396:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.559404:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8adab93/0x4a426866e6053b2c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.559530:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994186624:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 7279us (7485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.559542:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:0.0:1788305610.567318:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305610.568159:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187008 00000100:00100000:1.0:1788305610.568182:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187008 00000100:00100000:1.0:1788305610.568270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:1.0:1788305610.568314:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:11296:x1875173994187008:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788305610.569739:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.569781:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.569795:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.569898:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.569929:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 14 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.569947:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015241984:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305610.570083:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305610.576114:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.576343:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015241984:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305610.576381:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.576446:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187136 00000100:00100000:2.0:1788305610.576462:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187136 00010000:00010000:2.0:1788305610.576512:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.576569:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:2.0:1788305610.576580:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:2395:x1875173994187136:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305610.576598:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305610.576605:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576640:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576664:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08425 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576695:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.576702:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576713:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576721:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.576758:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305610.576828:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:2395:x1875173994187136:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 248us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305610.576838:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00010000:00010000:1.0:1788305610.577080:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577099:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577343:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577356:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577373:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577405:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 14 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.577419:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 14 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305610.577433:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015242112:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305610.577496:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305610.582546:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015242112:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305610.582584:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.583990:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305610.584109:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187264 00000100:00100000:0.0:1788305610.584122:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187264 00010000:00010000:0.0:1788305610.584183:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.584242:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788305610.584257:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:2395:x1875173994187264:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305610.584341:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305610.584352:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584372:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584406:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053af4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08487 expref: 15 pid: 6520 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584457:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:0.0:1788305610.584463:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584475:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584482:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.584520:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305610.584572:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305610.584594:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.584612:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:2395:x1875173994187264:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 356us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305610.584623:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000001:00080000:1.0:1788305610.584744:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788305610.584878:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788305610.584925:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788305610.585057:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015242240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788305610.585151:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305610.585210:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae480 going to sleep for 11 seconds 00000100:00100000:3.0:1788305610.585220:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015242240 00000100:00100000:3.0:1788305610.585230:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015242240 00000100:00100000:3.0:1788305610.585315:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788305610.585325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015242240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788305610.585465:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015242240:12345-0@lo:1000:mdt00_000.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.585473:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788305610.585637:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015242240:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788305610.585826:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788305610.585906:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015242368:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305610.585951:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305610.585975:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305610.586149:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015242368 00000100:00100000:2.0:1788305610.586155:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015242368 00000100:00100000:2.0:1788305610.586198:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788305610.586207:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015242368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788305610.586364:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6519:x1875174015242368:12345-0@lo:1000:mdt00_000.0 Request processed in 158us (412us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788305610.586389:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788305610.586747:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb26ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015242368:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788305610.586797:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586807:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586814:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586828:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305610.586834:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586842:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586863:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:0.0:1788305610.586866:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305610.586872:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586878:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053b3a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586915:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586922:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586928:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586933:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305610.586936:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586942:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586961:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:0.0:1788305610.586964:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305610.586967:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.586972:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053a68 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.587004:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.587021:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.587031:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.587063:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.587081:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 17 pid: 10615 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305610.587107:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015242496:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305610.587244:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305610.595634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.595962:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187392 00000100:00100000:3.0:1788305610.595980:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187392 00010000:00010000:3.0:1788305610.596053:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 18 pid: 10615 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.596118:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:3.0:1788305610.596161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2396:x1875173994187392:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305610.596182:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305610.596190:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 18 pid: 10615 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.596207:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 18 pid: 10615 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.596236:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:3.0:1788305610.596243:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.596255:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.596264:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.596311:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305610.596382:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2396:x1875173994187392:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 238us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305610.596390:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00010000:00010000:2.0:1788305610.597642:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053a84 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0846b expref: 17 pid: 10615 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.597671:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015242496:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305610.597709:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.597721:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.597728:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598029:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598039:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598047:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598054:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.598059:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598068:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598118:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.598121:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305610.598127:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598135:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053b41 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598150:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598157:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598163:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598168:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305610.598171:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598177:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598185:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362e300) 00010000:00010000:2.0:1788305610.598187:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305610.598190:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305610.598196:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053b33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305610.598823:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11296:x1875173994187008:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 30506us (31559us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788305610.598840:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000020:00080000:2.0:1788305610.598848:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788305610.598963:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305610.598972:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305610.598993:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788305610.599000:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305610.602817:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305610.602890:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187648 00000100:00100000:3.0:1788305610.602905:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187648 00000100:00100000:3.0:1788305610.603001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305610.603014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11296:x1875173994187648:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788305610.603631:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788305610.603674:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788305610.603732:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603751:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603764:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603773:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603780:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603786:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305610.603807:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305610.603906:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11296:x1875173994187648:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 894us (1109us total) trans 4294967364 rc 0/0 00010000:00010000:0.0:1788305610.604058:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305610.604084:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.604104:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305610.604110:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305610.604310:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000020:00080000:3.0:1788305610.604316:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305610.609463:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.609495:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:0.0:1788305610.609498:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305610.609505:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.609512:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b48 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305610.609751:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305610.609754:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305610.609758:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305610.838708:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305611.286755:0:14218:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305611.286768:0:14218:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305611.286799:0:14218:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788305611.286812:0:14218:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305611.425764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.426453:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994187904 00000100:00100000:3.0:1788305611.426469:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994187904 00000100:00100000:3.0:1788305611.426568:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:3.0:1788305611.426581:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:11310:x1875173994187904:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305611.426612:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305611.426639:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084a3 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.426835:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053b56 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.426854:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053b56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.426872:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053b56 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305611.426885:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788305611.427031:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084a3 expref: 21 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.427051:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053b56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084a3 expref: 20 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.427060:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305611.427063:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305611.427067:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305611.427167:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11310:x1875173994187904:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 589us (1418us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788305611.427176:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00080000:0.0:1788305611.427737:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305611.433122:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.444717:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994188032 00000100:00100000:2.0:1788305611.444749:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994188032 00000100:00100000:3.0:1788305611.446142:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:3.0:1788305611.446159:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11310:x1875173994188032:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:3.0:1788305611.446315:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446359:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446373:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446394:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446413:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446420:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446525:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446533:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446541:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305611.446602:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446617:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446624:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446643:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446651:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.446656:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446665:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446680:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305611.446684:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.446690:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446697:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053b64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446714:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446720:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446725:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446730:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.446733:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446750:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446759:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825b7a00) 00010000:00010000:3.0:1788305611.446762:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.446764:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446771:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053b6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446788:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446795:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446800:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446806:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.446808:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446814:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.446821:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305611.446824:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.447141:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.447160:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053b72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305611.447501:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11310:x1875173994188032:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 1342us (14389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305611.447513:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:0.0:1788305611.491462:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.491669:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994188288 00000100:00100000:2.0:1788305611.491683:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994188288 00000100:00100000:2.0:1788305611.491765:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:2.0:1788305611.491787:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11313:x1875173994188288:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305611.491816:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305611.492023:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053b79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084aa expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492141:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492160:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492175:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492194:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492201:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492225:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492426:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492435:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.492442:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305611.492454:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788305611.502997:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503023:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503032:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503040:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.503046:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503055:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503088:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305611.503092:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.503099:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503106:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053b80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503120:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503138:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503144:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503149:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.503153:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503159:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503168:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88908362e300) 00010000:00010000:3.0:1788305611.503170:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.503173:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503179:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053b87 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503259:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053b79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503306:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.503314:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.503316:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305611.503327:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ae00, rc 0) 00000100:00100000:3.0:1788305611.503442:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11313:x1875173994188288:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 11658us (11994us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788305611.503453:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:3.0:1788305611.510221:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.510432:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994188416 00000100:00100000:0.0:1788305611.510447:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994188416 00000100:00100000:0.0:1788305611.510532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:0.0:1788305611.510545:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11313:x1875173994188416:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305611.510656:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510677:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510690:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510743:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510752:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510760:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510767:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305611.510773:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510783:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510798:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:0.0:1788305611.510801:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305611.510808:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.510815:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053b9c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305611.510937:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11313:x1875173994188416:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 392us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.510946:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:1.0:1788305611.521440:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305611.521494:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994188672 00000100:00100000:1.0:1788305611.521507:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994188672 00000100:00100000:1.0:1788305611.521581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305611.521595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11313:x1875173994188672:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788305611.524069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:11313:x1875173994188672:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 2462us (2627us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788305611.524098:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:1.0:1788305611.573872:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.574006:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994188928 00000100:00100000:0.0:1788305611.574020:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994188928 00000100:00100000:0.0:1788305611.574108:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:0.0:1788305611.574128:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:10839:x1875173994188928:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.574165:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.574197:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053ba3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084b1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.574432:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.574451:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.574461:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.574505:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.574521:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 24 pid: 10615 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305611.574536:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8d44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015242624:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305611.574832:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305611.577216:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8d44e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015242624:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305611.577259:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305611.578339:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.578538:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189056 00000100:00100000:3.0:1788305611.578548:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189056 00010000:00010000:3.0:1788305611.578601:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 25 pid: 10615 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305611.578643:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:3.0:1788305611.578655:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:2396:x1875173994189056:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305611.578675:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305611.578684:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 25 pid: 10615 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578700:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 25 pid: 10615 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578729:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053b8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084aa expref: 25 pid: 10615 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578750:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.578756:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578776:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578806:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.578909:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.578918:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.578937:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:1.0:1788305611.578944:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788305611.579132:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053ba3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 26 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.579372:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 25 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.579381:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:1.0:1788305611.579384:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305611.579387:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8400, rc 0) 00000100:00100000:1.0:1788305611.579434:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:10839:x1875173994188928:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5314us (5576us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788305611.579442:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:3.0:1788305611.579715:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:2396:x1875173994189056:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 366us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305611.579728:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:1.0:1788305611.582010:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.582074:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189184 00000100:00100000:0.0:1788305611.582106:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189184 00000100:00100000:0.0:1788305611.582182:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:0.0:1788305611.582195:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:10839:x1875173994189184:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.582229:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.582257:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053bb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084b8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582343:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053bbf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582362:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582376:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053bbf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582554:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053bb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b8 expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582575:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053bbf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b8 expref: 25 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.582584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:0.0:1788305611.582588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305611.582592:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9e00, rc 0) 00000100:00100000:0.0:1788305611.582665:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:10839:x1875173994189184:12345-192.168.202.55@tcp:101:bash.0 Request processed in 472us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.582672:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:0.0:1788305611.584581:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.584640:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189440 00000100:00100000:3.0:1788305611.584652:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189440 00000100:00100000:3.0:1788305611.584719:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:3.0:1788305611.584732:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:10839:x1875173994189440:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:3.0:1788305611.585025:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.585048:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.585061:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305611.585126:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788305611.585158:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016a36401 reply state 000000004226e4cd transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.585173:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.585183:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.585186:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305611.585210:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788305611.585247:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788305611.585377:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:10839:x1875173994189440:12345-192.168.202.55@tcp:36:bash.0 Request processed in 646us (807us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788305611.585386:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 100 00000020:00080000:3.0:1788305611.585391:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788305611.586854:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.586962:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189568 00000100:00100000:3.0:1788305611.586972:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189568 00000100:00100000:3.0:1788305611.587035:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:3.0:1788305611.587047:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:10839:x1875173994189568:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305611.587088:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305611.587113:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053bcd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084bf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.587579:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053bcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084bf expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.587596:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053bcd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084bf expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.587620:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.587623:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305611.587628:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519400, rc 0) 00000100:00100000:3.0:1788305611.587708:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:10839:x1875173994189568:12345-192.168.202.55@tcp:101:bash.0 Request processed in 661us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305611.587715:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:1.0:1788305611.598892:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.599527:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189696 00000100:00100000:0.0:1788305611.599545:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189696 00000100:00100000:0.0:1788305611.599647:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305611.599667:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:10839:x1875173994189696:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.599700:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.599727:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084c6 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305611.599762:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9760c9, atime: 0x6a9760c7, ctime: 0x6a9760c9, blocks: 0x8 00010000:00010000:0.0:1788305611.599799:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1788305611.599803:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305611.599812:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.599831:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.599856:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8800, rc 0) 00000100:00100000:0.0:1788305611.599951:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:10839:x1875173994189696:12345-192.168.202.55@tcp:101:bash.0 Request processed in 288us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.599959:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:0.0:1788305611.602656:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.603526:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189824 00000100:00100000:2.0:1788305611.603545:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189824 00002000:00010000:2.0:1788305611.603608:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788305611.603614:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bb096680 with x1875173994189824 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305611.603633:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bb096680. 00000100:00100000:2.0:1788305611.603689:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788305611.603702:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994189824:12345-192.168.202.55@tcp:10:bash.0 00002000:00010000:2.0:1788305611.604099:0:8441:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788305611.604104:0:8441:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788305609 -> 1788305611 00002000:00010000:2.0:1788305611.604108:0:8441:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788305607 -> 1788305607 00002000:00010000:2.0:1788305611.604110:0:8441:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788305609 -> 1788305611 00002000:00010000:2.0:1788305611.604113:0:8441:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788305611.604213:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994189824:12345-192.168.202.55@tcp:10:bash.0 Request processed in 511us (1568us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788305611.604239:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00002000:00010000:2.0:1788305611.604244:0:8441:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1788305611.604247:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bb096680 with x1875173994189824 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305611.604253:0:8441:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bb096680. 00000100:00100000:2.0:1788305611.677111:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305611.677965:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994189952 00000100:00100000:1.0:1788305611.677981:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994189952 00000100:00100000:1.0:1788305611.678192:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:1.0:1788305611.678207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11327:x1875173994189952:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:1.0:1788305611.678353:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678376:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678390:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678607:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678617:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678642:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678748:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678758:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.678766:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305611.679500:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679520:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679528:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679896:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679903:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305611.679963:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679972:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.679988:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305611.680007:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305611.680014:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680144:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053bdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680169:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680176:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680183:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680188:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305611.680192:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680198:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680207:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:1.0:1788305611.680211:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305611.680214:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680220:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053be2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680239:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680253:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680259:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680265:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305611.680268:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680785:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680800:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:1.0:1788305611.680802:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305611.680806:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.680811:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053be9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305611.681758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11327:x1875173994189952:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 3543us (4655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305611.681861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:0.0:1788305611.733581:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.733697:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994190208 00000100:00100000:3.0:1788305611.733710:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994190208 00000100:00100000:3.0:1788305611.733838:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:3.0:1788305611.733870:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11330:x1875173994190208:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305611.733898:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305611.733926:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053bf0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084cd expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734022:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734053:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734092:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734100:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734107:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734302:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053c05 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734321:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053c05 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305611.734342:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788305611.734442:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734451:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734459:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734466:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.734471:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734480:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734495:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:3.0:1788305611.734499:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.734504:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734511:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6053bf7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734527:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734534:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734551:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734558:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305611.734562:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734569:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734578:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8890825b7000) 00010000:00010000:3.0:1788305611.734581:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305611.734584:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734590:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6053bfe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734641:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e6053bf0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084cd expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734656:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053c05 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084cd expref: 32 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.734664:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.734666:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305611.734669:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ae00, rc 0) 00000100:00100000:3.0:1788305611.734756:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11330:x1875173994190208:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 889us (1190us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788305611.734774:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:0.0:1788305611.738562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.738694:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994190336 00000100:00100000:3.0:1788305611.738707:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994190336 00000100:00100000:3.0:1788305611.738829:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:3.0:1788305611.738843:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11330:x1875173994190336:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788305611.738935:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.738957:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.738969:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.739016:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.739033:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 32 pid: 6520 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305611.739051:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015242752:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305611.739203:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305611.743904:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.744024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994190592 00000100:00100000:2.0:1788305611.744036:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994190592 00000100:00100000:3.0:1788305611.744159:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015242752:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305611.744183:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:3.0:1788305611.744195:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305611.744199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:6168:x1875173994190592:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788305611.744646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:6168:x1875173994190592:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 449us (755us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788305611.744655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305611.746739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305611.746916:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994190720 00000100:00100000:3.0:1788305611.746961:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994190720 00010000:00010000:3.0:1788305611.747014:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 34 pid: 6520 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305611.747061:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:3.0:1788305611.747074:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:2396:x1875173994190720:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305611.747104:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305611.747114:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 34 pid: 6520 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747131:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 34 pid: 6520 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747159:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6053baa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b1 expref: 34 pid: 6520 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747179:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:3.0:1788305611.747185:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747196:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747204:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305611.747342:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305611.747409:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:2396:x1875173994190720:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 336us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305611.747431:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00010000:00010000:0.0:1788305611.750094:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750139:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750203:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750212:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750220:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750226:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305611.750232:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750240:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750264:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:0.0:1788305611.750268:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305611.750340:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.750348:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053c13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305611.750549:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11330:x1875173994190336:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 11701us (11993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.750570:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:0.0:1788305611.755569:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305611.755763:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994190976 00000100:00100000:1.0:1788305611.755776:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994190976 00000100:00100000:1.0:1788305611.755852:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788305611.755864:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:11330:x1875173994190976:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788305611.757497:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:11330:x1875173994190976:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 1623us (1932us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1788305611.757510:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788305611.839395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.839819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994191232 00000100:00100000:2.0:1788305611.839907:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994191232 00000100:00100000:2.0:1788305611.840036:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:2.0:1788305611.840049:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:11341:x1875173994191232:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788305611.840094:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305611.840122:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053c1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084d4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840247:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840271:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840319:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840364:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840373:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840381:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840542:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053c2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840573:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053c2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305611.840587:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788305611.840686:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840694:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840702:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840709:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305611.840714:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840735:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840750:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305611.840753:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305611.840760:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840767:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053c21 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840784:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840790:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840796:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840802:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305611.840805:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840811:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840819:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88908362ef00) 00010000:00010000:2.0:1788305611.840822:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305611.840825:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840855:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c28 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053c1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084d4 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840924:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053c2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084d4 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.840932:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:2.0:1788305611.840935:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305611.840938:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305611.841378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11341:x1875173994191232:12345-192.168.202.55@tcp:101:cat.0 Request processed in 1328us (1997us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788305611.841389:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:3.0:1788305611.845879:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305611.846057:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994191488 00000100:00100000:1.0:1788305611.846068:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994191488 00000100:00100000:1.0:1788305611.846176:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788305611.846191:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11341:x1875173994191488:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:1.0:1788305611.846592:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:11341:x1875173994191488:12345-192.168.202.55@tcp:35:cat.0 Request processed in 404us (726us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788305611.846601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788305611.864992:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305611.865314:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994191744 00000100:00100000:1.0:1788305611.865327:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994191744 00000100:00100000:1.0:1788305611.865412:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:1.0:1788305611.865426:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:11342:x1875173994191744:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:1.0:1788305611.865514:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788305611.865550:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6053bcd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084bf expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865578:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053c2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084d4 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865591:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053c05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084cd expref: 34 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865603:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053bbf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084b8 expref: 33 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865641:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:1.0:1788305611.865647:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305611.865677:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865694:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865707:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865725:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865733:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865740:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865844:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865854:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.865862:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305611.866163:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788305611.866175:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 441956899207ns, next at 442956895563ns, rc = 0 00010000:00010000:1.0:1788305611.866433:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866444:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866453:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866460:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866466:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866472:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866487:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305611.866510:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866516:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866523:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866530:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305611.866536:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866545:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866565:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:1.0:1788305611.866568:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788305611.866576:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866583:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e6053c4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866600:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866607:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866612:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866617:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305611.866620:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866625:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866632:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305611.866634:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305611.866638:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866643:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053c3d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305611.866666:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b15b9030 reply state 00000000cf56d2ea transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866678:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305611.866685:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:1.0:1788305611.866688:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305611.866691:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305611.866790:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083643100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:11342:x1875173994191744:12345-192.168.202.55@tcp:36:rm.0 Request processed in 1365us (1813us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788305611.866800:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 106 00010000:00010000:0.0:1788305611.867445:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305611.867455:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.867463:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305611.867468:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.867476:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.867489:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:0.0:1788305611.867491:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305611.867494:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.867501:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053c52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.867514:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305611.867516:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305611.867517:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305611.868192:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305611.915460:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.915888:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192000 00000100:00100000:0.0:1788305611.915903:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192000 00000100:00100000:0.0:1788305611.916001:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:0.0:1788305611.916015:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:11348:x1875173994192000:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.916057:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.916097:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053c59 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084db expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916312:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916332:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916350:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916366:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916373:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.916380:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305611.916860:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788305611.917047:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917060:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917069:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917126:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917148:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917156:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917164:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305611.917171:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917179:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917198:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305611.917202:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305611.917208:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053c60 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305611.917233:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6262604 reply state 0000000058cddcd7 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917246:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917253:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:0.0:1788305611.917255:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305611.917258:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788305611.917349:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053c59 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917378:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 36 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.917386:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:0.0:1788305611.917388:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305611.917391:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305611.917493:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:11348:x1875173994192000:12345-192.168.202.55@tcp:101:bash.0 Request processed in 1480us (2050us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788305611.917503:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:3.0:1788305611.921317:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.921480:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192128 00000100:00100000:0.0:1788305611.921494:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192128 00000100:00100000:0.0:1788305611.921600:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788305611.921614:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2398:x1875173994192128:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.921639:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.921681:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084e2 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305611.921717:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305611.921743:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1788305611.921749:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305611.921761:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.921783:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.921825:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9400, rc 0) 00000100:00100000:0.0:1788305611.921910:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2398:x1875173994192128:12345-192.168.202.55@tcp:101:bash.0 Request processed in 298us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.921918:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00080000:2.0:1788305611.921997:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305611.924412:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305611.924622:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192256 00000100:00100000:0.0:1788305611.924635:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192256 00000100:00100000:0.0:1788305611.924702:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788305611.924712:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:11348:x1875173994192256:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305611.924735:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305611.924756:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084e9 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.924801:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 9 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.924813:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305611.924817:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305611.924823:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.924871:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 9 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.924888:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 9 pid: 8758 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305611.924927:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015242880:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305611.925108:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305611.928905:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.928994:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192384 00000100:00100000:2.0:1788305611.929005:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192384 00010000:00010000:2.0:1788305611.929059:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 10 pid: 8758 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305611.929120:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:2.0:1788305611.929135:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2396:x1875173994192384:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305611.929160:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788305611.929186:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015242880:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305611.929192:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 10 pid: 8758 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.929225:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.929235:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 10 pid: 8758 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305611.931438:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9800, rc 0) 00000100:00100000:0.0:1788305611.931909:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:11348:x1875173994192256:12345-192.168.202.55@tcp:101:bash.0 Request processed in 7119us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305611.931921:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00010000:00010000:2.0:1788305611.933729:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc43caea/0x4a426866e6053c7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e2 expref: 9 pid: 8758 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.933764:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305611.933770:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305611.933781:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.933794:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305611.933869:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305611.933889:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1875174015243008:192.168.202.55@tcp:105: 00000100:00100000:2.0:1788305611.934000:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305611.937709:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1875174015243008:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788305611.937751:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305611.937839:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994192384:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 8707us (8947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305611.937853:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:1.0:1788305611.940162:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305611.940304:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192640 00000100:00100000:2.0:1788305611.940317:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192640 00000100:00100000:2.0:1788305611.940428:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305611.940441:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:11348:x1875173994192640:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:2.0:1788305611.941040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11348:x1875173994192640:12345-192.168.202.55@tcp:35:bash.0 Request processed in 600us (889us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788305611.941050:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788305612.112328:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.112958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994192768 00000100:00100000:2.0:1788305612.112973:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994192768 00000100:00100000:2.0:1788305612.113062:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:2.0:1788305612.113085:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:11364:x1875173994192768:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305612.113121:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.113149:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084f0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113245:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113264:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113329:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305612.113392:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788305612.113397:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305612.113422:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113454:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f0 expref: 40 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113498:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f0 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.113507:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305612.113510:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305612.113514:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:2.0:1788305612.113600:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:11364:x1875173994192768:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 527us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.113608:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:3.0:1788305612.121421:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.121564:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193024 00000100:00100000:0.0:1788305612.121579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193024 00000100:00100000:0.0:1788305612.121675:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:0.0:1788305612.121690:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:11364:x1875173994193024:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305612.121722:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.121758:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053c98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084f7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.121934:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053c9f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.121953:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.121968:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053c9f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305612.122003:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788305612.122174:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053c98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f7 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.122198:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053c9f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f7 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.122223:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:0.0:1788305612.122227:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305612.122231:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305612.124722:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+41:11364:x1875173994193024:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 3017us (3300us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1788305612.124741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 109 00000100:00100000:1.0:1788305612.132433:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.132486:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.132500:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193280 00000100:00100000:2.0:1788305612.132512:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193280 00000100:00100000:2.0:1788305612.132600:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:3.0:1788305612.132616:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193408 00000100:00100000:3.0:1788305612.132621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193408 00000100:00100000:3.0:1788305612.132671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305612.132681:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:2395:x1875173994193408:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.132701:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.132735:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053c9f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f7 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.132762:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:3.0:1788305612.132768:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305612.132785:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+41:11364:x1875173994193280:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305612.132811:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.132830:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053cad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe084fe expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.132852:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:2395:x1875173994193408:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 173us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.132860:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00010000:00010000:2.0:1788305612.133004:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.133021:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.133035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305612.133050:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788305612.135636:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053cad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084fe expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.135671:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084fe expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.135683:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:3.0:1788305612.135704:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788305612.135709:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:3.0:1788305612.135813:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:11364:x1875173994193280:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 3200us (3393us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788305612.135824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 110 00000100:00100000:1.0:1788305612.147498:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.148505:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193536 00000100:00100000:0.0:1788305612.148521:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193536 00000100:00100000:0.0:1788305612.148599:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788305612.148611:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994193536:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:0.0:1788305612.148679:0:8758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.148707:0:8758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.148717:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305612.148722:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305612.148727:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.148821:0:8758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.148839:0:8758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 8 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.148857:0:8758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8758:1875174015243136:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305612.148987:0:8758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825680c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.158456:0:8758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083640700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8758:1875174015243136:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.158508:0:8758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.158682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.158767:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193664 00000100:00100000:2.0:1788305612.158778:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193664 00002000:00100000:2.0:1788305612.158854:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8891903d7480 x1875173994193664/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:543/0 lens 504/0 e 0 to 0 dl 1788305623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305612.158864:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891903d7480 with x1875173994193664 ext(0->8) 00010000:00010000:2.0:1788305612.158873:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 9 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.158890:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 9 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305612.158899:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8891903d7480 00000100:00100000:2.0:1788305612.158993:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:2.0:1788305612.159006:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994193664:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:2.0:1788305612.161204:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2395:x1875173994193664:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 2183us (2917us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788305612.161223:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00002000:00100000:2.0:1788305612.161238:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8891903d7480 x1875173994193664/t4294967303(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:543/0 lens 504/448 e 0 to 0 dl 1788305623 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305612.161249:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891903d7480 with x1875173994193664 ext(0->8) 00010000:00010000:2.0:1788305612.161262:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.161313:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305612.161349:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8891903d7480 00000100:00100000:3.0:1788305612.163881:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.164199:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994193792 00000100:00100000:1.0:1788305612.164213:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994193792 00010000:00010000:1.0:1788305612.164268:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.164356:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:1.0:1788305612.164368:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2396:x1875173994193792:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305612.164408:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788305612.164432:0:7471:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788305612.164434:0:7471:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788305611 00002000:00010000:1.0:1788305612.164437:0:7471:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788305611 00002000:00010000:1.0:1788305612.164439:0:7471:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788305611 00002000:00010000:1.0:1788305612.164442:0:7471:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788305612.164449:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164465:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164495:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1feeaad/0x4a426866e6053c83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084e9 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164517:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305612.164522:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305612.164531:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164543:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164581:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305612.164646:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844ce050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2396:x1875173994193792:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 280us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.164653:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00010000:00010000:1.0:1788305612.164887:0:8758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164899:0:8758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164924:0:8758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164934:0:8758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164943:0:8758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164951:0:8758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305612.164957:0:8758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164967:0:8758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164982:0:8758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.164989:0:8758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a711d3e5/0x4a426866e6053cc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.165058:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994193536:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 16449us (17574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.165067:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788305612.176574:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.176739:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194048 00000100:00100000:1.0:1788305612.176753:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194048 00000100:00100000:1.0:1788305612.176834:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305612.176853:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:11364:x1875173994194048:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:1.0:1788305612.176945:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084fe expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305612.177349:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788305612.177388:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788305612.177818:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:1.0:1788305612.177867:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.177887:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.177898:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.177946:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 46 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.177965:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 46 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.177996:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015243264:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305612.178152:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305612.182923:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.183038:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194176 00000100:00100000:2.0:1788305612.183051:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194176 00010000:00010000:2.0:1788305612.183115:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 47 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.183184:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305612.183196:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:2395:x1875173994194176:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305612.183216:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305612.183224:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 47 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.183240:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 47 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.183271:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:2.0:1788305612.183335:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.183348:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.183357:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.183384:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305612.183451:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:2395:x1875173994194176:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 256us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.183480:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00010000:00010000:3.0:1788305612.184180:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053c6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084db expref: 46 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.184206:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015243264:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305612.184238:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.184248:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.184254:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305612.184475:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788305612.184782:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788305612.184929:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015243392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788305612.185011:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305612.185059:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.185335:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015243392 00000100:00100000:2.0:1788305612.185344:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015243392 00000100:00100000:2.0:1788305612.185429:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788305612.185440:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015243392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305612.185680:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015243392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 241us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.185689:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00080000:0.0:1788305612.185730:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305612.185785:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015243392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788305612.185962:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1788305612.186019:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015243520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788305612.186055:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305612.186092:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.186395:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015243520 00000100:00100000:2.0:1788305612.186400:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015243520 00000100:00100000:2.0:1788305612.186440:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788305612.186448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015243520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305612.186642:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6523:x1875174015243520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 193us (585us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788305612.186649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788305612.187109:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015243520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788305612.187193:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1788305612.187243:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187255:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187264:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187271:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.187305:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187314:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187333:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:1.0:1788305612.187353:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788305612.187359:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.187366:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053cc9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788305612.187478:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788305612.187711:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1788305612.187726:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442278450485ns, next at 443278447497ns, rc = 0 00000001:00080000:1.0:1788305612.187735:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:1.0:1788305612.187764:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff889186383d00) 00010000:00010000:1.0:1788305612.187767:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305612.187775:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053cb4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084fe expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.187904:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:11364:x1875173994194048:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 11053us (11357us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788305612.187913:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000020:00080000:1.0:1788305612.187918:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788305612.191602:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.191728:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194304 00000100:00100000:3.0:1788305612.191743:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194304 00000100:00100000:3.0:1788305612.191823:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:3.0:1788305612.191836:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:11364:x1875173994194304:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305612.191900:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305612.191932:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053cd0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08505 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.192012:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08505 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.192030:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08505 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.192051:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.192055:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305612.192060:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a200, rc 0) 00000100:00100000:3.0:1788305612.192154:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:11364:x1875173994194304:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 320us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.192161:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:3.0:1788305612.195824:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.196004:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194560 00000100:00100000:2.0:1788305612.196016:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194560 00000100:00100000:2.0:1788305612.196099:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788305612.196111:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:11364:x1875173994194560:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305612.196499:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:11364:x1875173994194560:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 387us (687us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788305612.196507:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:3.0:1788305612.245686:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015243648:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305612.245786:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305612.245967:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015243648 00000100:00100000:0.0:1788305612.245978:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015243648 00000100:00100000:0.0:1788305612.246047:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788305612.246058:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015243648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305612.246180:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788305612.246258:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015243648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.246265:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788305612.247008:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015243776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305612.247067:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305612.247132:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015243776 00000100:00100000:2.0:1788305612.247171:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015243776 00000100:00100000:2.0:1788305612.247218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788305612.247227:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015243776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305612.247257:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305612.247325:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015243776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.247333:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788305612.247389:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015243776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305612.247878:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015243648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305612.295346:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.295529:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194688 00000100:00100000:1.0:1788305612.295543:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194688 00000100:00100000:1.0:1788305612.295641:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:1.0:1788305612.295654:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:11374:x1875173994194688:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:1.0:1788305612.295759:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295782:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295816:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295845:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295855:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295862:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295974:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295983:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.295989:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305612.296060:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296089:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296098:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296105:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296123:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.296129:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296137:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296163:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305612.296166:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305612.296172:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296178:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053cd7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296196:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296202:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296208:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296212:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.296215:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296220:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296237:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:1.0:1788305612.296239:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305612.296242:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296249:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053cde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296260:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296265:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296270:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296333:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.296336:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296342:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296350:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.296353:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305612.296356:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.296361:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ce5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.296484:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083640700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:11374:x1875173994194688:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 831us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.296493:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:3.0:1788305612.335091:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.335330:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994194944 00000100:00100000:0.0:1788305612.335343:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994194944 00000100:00100000:0.0:1788305612.335441:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:0.0:1788305612.335453:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:11377:x1875173994194944:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305612.335480:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.335507:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6053cec lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0850c expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335616:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335635:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335649:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335664:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335672:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335679:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335824:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335845:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335853:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305612.335878:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788305612.335980:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335989:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.335996:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336004:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.336010:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336018:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336034:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:0.0:1788305612.336037:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.336043:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336050:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053cf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336067:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336084:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336101:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336106:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.336110:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336116:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336125:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:0.0:1788305612.336127:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.336130:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336135:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053cfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336192:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6053cec lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336211:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.336219:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.336221:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305612.336224:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305612.336736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11377:x1875173994194944:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1282us (1668us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788305612.336758:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 113 00000100:00100000:2.0:1788305612.343252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.346134:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195072 00000100:00100000:1.0:1788305612.346546:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195072 00000100:00100000:1.0:1788305612.346784:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:1.0:1788305612.346798:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11377:x1875173994195072:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:1.0:1788305612.346912:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.346935:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.346948:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.346996:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347003:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347010:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347017:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.347022:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347030:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347066:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.347080:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305612.347087:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.347094:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053d0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.347215:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11377:x1875173994195072:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 419us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.347223:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 114 00000100:00100000:3.0:1788305612.349955:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.350469:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195328 00000100:00100000:2.0:1788305612.350483:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195328 00000100:00100000:2.0:1788305612.350571:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788305612.350584:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:11377:x1875173994195328:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305612.351018:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11377:x1875173994195328:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 434us (1074us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788305612.351026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788305612.402839:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.402973:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195456 00000100:00100000:3.0:1788305612.402986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195456 00000100:00100000:3.0:1788305612.403057:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 387 00000100:00100000:3.0:1788305612.403096:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994195456:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305612.403224:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994195456:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 155us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.403232:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 387 00000100:00100000:0.0:1788305612.406419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.406557:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195584 00000100:00100000:3.0:1788305612.406572:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195584 00000100:00100000:3.0:1788305612.406677:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 311 00000100:00100000:3.0:1788305612.406693:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994195584:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305612.406804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083641f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994195584:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 116us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.406814:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 311 00000100:00080000:0.0:1788305612.407328:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305612.415125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.415206:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.415377:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195712 00000100:00100000:1.0:1788305612.415391:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195712 00000100:00100000:1.0:1788305612.415486:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994195840 00000100:00100000:1.0:1788305612.415490:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994195840 00000100:00100000:1.0:1788305612.415518:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 312 00000100:00100000:1.0:1788305612.415532:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994195712:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305612.415659:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994195712:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 128us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.415668:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 312 00000100:00100000:1.0:1788305612.415690:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 313 00000100:00100000:1.0:1788305612.415698:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994195840:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305612.415728:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994195840:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.415734:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 313 00000100:00080000:0.0:1788305612.416793:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305612.416803:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305612.433449:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.433586:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196096 00000100:00100000:1.0:1788305612.433620:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196096 00000100:00100000:1.0:1788305612.433705:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:1.0:1788305612.433719:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11387:x1875173994196096:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305612.433757:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.433762:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788305612.433798:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053c91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084f0 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.433822:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305612.433827:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305612.433853:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d16 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08513 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.433996:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.434012:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.434021:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.434061:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.434088:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 54 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.434104:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015243904:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305612.434530:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.437371:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015243904:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.437418:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.440157:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.440534:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196224 00000100:00100000:0.0:1788305612.440557:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196224 00010000:00010000:0.0:1788305612.440616:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.440667:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:0.0:1788305612.440680:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:2396:x1875173994196224:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305612.440702:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305612.440711:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440730:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440760:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d01 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0850c expref: 55 pid: 6521 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440806:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.440813:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440824:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440934:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.440972:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305612.441054:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:2396:x1875173994196224:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 376us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.441062:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00010000:00010000:1.0:1788305612.441134:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.441155:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305612.441184:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788305612.441420:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d16 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 55 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.441438:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 54 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.441458:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.441461:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305612.441464:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51e00, rc 0) 00000100:00100000:1.0:1788305612.441499:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11387:x1875173994196096:12345-192.168.202.55@tcp:101:bash.0 Request processed in 7783us (8067us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788305612.441507:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 115 00000100:00100000:1.0:1788305612.445794:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.445898:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196352 00000100:00100000:0.0:1788305612.445913:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196352 00000100:00100000:0.0:1788305612.445992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:0.0:1788305612.446005:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:11387:x1875173994196352:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305612.446036:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.446063:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053d2b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0851a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446122:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446141:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446180:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446381:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053d2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 56 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446405:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.446416:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.446420:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305612.446424:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8600, rc 0) 00000100:00100000:0.0:1788305612.446500:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:11387:x1875173994196352:12345-192.168.202.55@tcp:101:bash.0 Request processed in 497us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.446508:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 116 00000100:00100000:2.0:1788305612.450445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.450614:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196608 00000100:00100000:1.0:1788305612.450628:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196608 00000100:00100000:1.0:1788305612.450705:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 117 00000100:00100000:1.0:1788305612.450718:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:11387:x1875173994196608:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:1.0:1788305612.451056:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.451088:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.451127:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305612.451182:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:1.0:1788305612.451211:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ac67e51 reply state 000000007b1077ab transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.451227:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.451234:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.451237:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305612.451241:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305612.451400:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11387:x1875173994196608:12345-192.168.202.55@tcp:36:bash.0 Request processed in 682us (969us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788305612.451410:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 117 00000020:00080000:1.0:1788305612.451416:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788305612.455012:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.455122:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196736 00000100:00100000:0.0:1788305612.455138:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196736 00000100:00100000:0.0:1788305612.455217:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:0.0:1788305612.455230:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11387:x1875173994196736:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305612.455264:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.455350:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08521 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.455497:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.455516:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.455534:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.455593:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.455609:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 59 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.455626:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015244032:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305612.455741:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.459196:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.459355:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015244032:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.459394:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.459521:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994196864 00000100:00100000:3.0:1788305612.459532:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994196864 00010000:00010000:3.0:1788305612.459585:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 60 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.459632:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:3.0:1788305612.459644:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:2395:x1875173994196864:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.459662:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.459670:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 60 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459684:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 60 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459713:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d1d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08513 expref: 60 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459761:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.459766:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459779:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459789:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.459883:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.459955:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:2395:x1875173994196864:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 312us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.459964:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00010000:00010000:1.0:1788305612.461808:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.461827:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305612.461924:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788305612.461930:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305612.461959:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.462009:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053d40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.462064:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 58 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.462087:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.462091:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305612.462096:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9800, rc 0) 00000100:00100000:1.0:1788305612.462437:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11387:x1875173994196736:12345-192.168.202.55@tcp:101:bash.0 Request processed in 7206us (7438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.462447:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:2.0:1788305612.466510:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.466615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197120 00000100:00100000:1.0:1788305612.466629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197120 00000100:00100000:1.0:1788305612.466705:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788305612.466742:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:11387:x1875173994197120:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:1.0:1788305612.467222:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11387:x1875173994197120:12345-192.168.202.55@tcp:35:bash.0 Request processed in 504us (725us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788305612.467231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788305612.529548:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.529750:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197248 00000100:00100000:1.0:1788305612.529764:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197248 00000100:00100000:1.0:1788305612.529903:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:1.0:1788305612.529928:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:11393:x1875173994197248:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305612.529964:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.529993:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08528 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530098:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530137:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530163:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305612.530225:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788305612.530230:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305612.530257:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530396:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053d4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08528 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530421:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08528 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.530431:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305612.530434:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305612.530439:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305612.530566:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994197248:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 652us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.530576:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:2.0:1788305612.537026:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.538095:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197376 00000100:00100000:3.0:1788305612.538112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197376 00000100:00100000:2.0:1788305612.538469:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:2.0:1788305612.538505:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994197376:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305612.538538:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.538771:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053d5c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0852f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539019:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539040:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539054:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539079:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539089:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539095:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539272:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539323:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539330:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305612.539407:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788305612.539412:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305612.539438:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539453:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539462:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539468:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539475:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539482:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305612.539487:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539495:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539510:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305612.539513:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305612.539519:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539526:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d63 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539693:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539701:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539707:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539713:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305612.539716:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539723:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539731:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:2.0:1788305612.539734:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305612.539737:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539743:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053d6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539780:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053d5c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0852f expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539796:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0852f expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.539890:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:2.0:1788305612.539894:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305612.539897:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea800, rc 0) 00000100:00100000:2.0:1788305612.540219:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11393:x1875173994197376:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1716us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.540230:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:2.0:1788305612.543588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.543766:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197504 00000100:00100000:3.0:1788305612.543781:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197504 00000100:00100000:3.0:1788305612.543893:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788305612.543907:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:2395:x1875173994197504:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.543941:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.543977:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053d71 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0852f expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.544005:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.544011:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.544097:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:2395:x1875173994197504:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 192us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.544126:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788305612.548910:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.549092:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197760 00000100:00100000:0.0:1788305612.549106:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197760 00000100:00100000:0.0:1788305612.549194:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:0.0:1788305612.549207:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994197760:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305612.549255:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.549332:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053d78 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08536 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.549486:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.549505:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.549536:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.549584:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.549601:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 61 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.549618:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015244160:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305612.549736:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.554610:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.555042:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994197888 00000100:00100000:3.0:1788305612.555055:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994197888 00010000:00010000:3.0:1788305612.555125:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 62 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.555178:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:3.0:1788305612.555190:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:2395:x1875173994197888:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.555212:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.555221:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 62 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.555236:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 62 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.555264:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.555270:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.555331:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.555340:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.555365:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.555432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:2395:x1875173994197888:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 243us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.555461:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00010000:00010000:0.0:1788305612.555580:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d47 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08521 expref: 61 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.555602:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015244160:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.555640:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.555650:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.555657:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305612.555680:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788305612.555854:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053d78 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 62 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.555885:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.555894:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.555897:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788305612.555900:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305612.556196:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11393:x1875173994197760:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 6990us (7299us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788305612.556204:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:2.0:1788305612.560417:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.560577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198144 00000100:00100000:0.0:1788305612.560592:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198144 00000100:00100000:0.0:1788305612.560691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:0.0:1788305612.560707:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11393:x1875173994198144:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:0.0:1788305612.560731:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305612.560764:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053cd0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08505 expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.560787:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.560793:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305612.560882:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994198144:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 179us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.560891:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:2.0:1788305612.564348:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.564601:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198272 00000100:00100000:1.0:1788305612.564616:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198272 00000100:00100000:1.0:1788305612.564709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:1.0:1788305612.564723:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994198272:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:1.0:1788305612.565054:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.565877:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.565899:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305612.566536:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788305612.567476:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994198272:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 2740us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.567492:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:1.0:1788305612.572420:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.572707:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198400 00000100:00100000:2.0:1788305612.572720:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198400 00000100:00100000:2.0:1788305612.572843:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:2.0:1788305612.572856:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:11393:x1875173994198400:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305612.572887:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.572923:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0853d expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.572998:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.573012:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.573037:0:6521:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.573086:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.573103:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:2.0:1788305612.573107:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305612.573111:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.573120:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea000, rc 0) 00000100:00100000:2.0:1788305612.573205:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11393:x1875173994198400:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 352us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.573213:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 123 00000040:00080000:1.0:1788305612.629741:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305612.629756:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305612.629804:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788305612.630004:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305612.630246:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015244288:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305612.630479:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305612.667452:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.667593:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198528 00000100:00100000:2.0:1788305612.667606:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198528 00000100:00100000:2.0:1788305612.667695:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:2.0:1788305612.667708:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994198528:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305612.667758:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305612.667933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994198528:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 226us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.667942:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:3.0:1788305612.668591:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015244288:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305612.672751:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.676809:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198656 00000100:00100000:0.0:1788305612.676903:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198656 00000100:00100000:0.0:1788305612.677478:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:0.0:1788305612.677512:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11394:x1875173994198656:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788305612.677631:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677667:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677681:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677702:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677709:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677716:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677744:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677753:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677759:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305612.677822:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788305612.677836:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305612.677854:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677879:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677886:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677894:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677901:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.677906:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677924:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677939:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:0.0:1788305612.677942:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.677947:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677953:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053d9b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677971:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677978:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677984:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.677997:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.678000:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678006:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678014:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff889186383500) 00010000:00010000:0.0:1788305612.678017:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.678019:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678025:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053da2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678041:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678047:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678053:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678057:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.678060:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678076:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678096:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.678099:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.678102:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.678108:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053da9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.678237:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11394:x1875173994198656:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 726us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.678247:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:0.0:1788305612.684064:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.684778:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994198912 00000100:00100000:2.0:1788305612.684792:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994198912 00000100:00100000:2.0:1788305612.684874:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788305612.684886:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:11394:x1875173994198912:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.684927:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.684984:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053db0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08544 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685175:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685195:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685208:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305612.685222:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788305612.685353:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685362:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685370:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305612.685382:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685390:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685406:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:2.0:1788305612.685410:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788305612.685416:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685433:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053db7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685492:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053db0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08544 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685503:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:2.0:1788305612.685506:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305612.685510:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053db0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08544 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.685521:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305612.685840:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994198912:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 953us (1792us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788305612.685851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:1.0:1788305612.692083:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.692218:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994199040 00000100:00100000:2.0:1788305612.692232:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994199040 00000100:00100000:2.0:1788305612.692339:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:2.0:1788305612.692354:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994199040:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305612.692406:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305612.692580:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994199040:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 229us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.692589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:3.0:1788305612.698608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.698872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994199296 00000100:00100000:2.0:1788305612.698892:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994199296 00000100:00100000:2.0:1788305612.699089:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:2.0:1788305612.699121:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994199296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.699673:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.699679:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305612.699718:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053d55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08528 expref: 62 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.699743:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305612.699748:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305612.699766:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053dc5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0854b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305612.700713:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788305612.700943:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053dcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.700964:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.700977:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053dcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.701054:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053dc5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0854b expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.701086:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053dcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0854b expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.701096:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff88908362ef00) 00010000:00010000:2.0:1788305612.701099:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305612.701119:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305612.701235:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:11394:x1875173994199296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 2115us (2643us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788305612.701253:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:1.0:1788305612.705052:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.705438:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994199552 00000100:00100000:2.0:1788305612.705452:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994199552 00000100:00100000:2.0:1788305612.705574:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:2.0:1788305612.705588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:11394:x1875173994199552:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.705667:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305612.705703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053dcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0854b expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705726:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff88908362ef00) 00010000:00010000:2.0:1788305612.705740:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305612.705767:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705784:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705795:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705812:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705818:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705825:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705978:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705986:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.705994:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706000:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305612.706005:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706013:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706022:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:2.0:1788305612.706025:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305612.706029:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706035:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053dda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706045:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706051:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706057:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706080:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305612.706083:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706089:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706098:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x21723457 (ffff88908362e800) 00010000:00010000:2.0:1788305612.706101:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305612.706104:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.706109:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053de1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21723457 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.706233:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994199552:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 647us (1195us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305612.706241:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:1.0:1788305612.708662:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.708880:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994199680 00000100:00100000:0.0:1788305612.708894:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994199680 00000100:00100000:0.0:1788305612.709104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:0.0:1788305612.709116:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:11394:x1875173994199680:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305612.709144:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305612.709182:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053de8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08552 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709231:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709246:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709259:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6053de8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709477:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.709487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:0.0:1788305612.709490:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305612.709495:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9400, rc 0) 00000100:00100000:0.0:1788305612.709588:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:11394:x1875173994199680:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 475us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.709596:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:2.0:1788305612.712588:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.712860:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994199936 00000100:00100000:0.0:1788305612.712874:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994199936 00000100:00100000:0.0:1788305612.712959:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:0.0:1788305612.712972:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:11394:x1875173994199936:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788305612.713105:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.713129:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.713145:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305612.713418:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:0.0:1788305612.713495:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf06dee5 reply state 00000000a8da5038 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.713532:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.713542:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:0.0:1788305612.713545:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788305612.713562:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305612.713705:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:11394:x1875173994199936:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 733us (1128us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788305612.713714:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:3.0:1788305612.716199:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.716603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200064 00000100:00100000:1.0:1788305612.716618:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200064 00000100:00100000:1.0:1788305612.716699:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:1.0:1788305612.716712:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:11394:x1875173994200064:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305612.716772:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.716805:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08559 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.716930:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.716949:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.716973:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:1.0:1788305612.716977:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305612.716982:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:1.0:1788305612.717083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:11394:x1875173994200064:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 373us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.717091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:3.0:1788305612.719758:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.719837:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200192 00000100:00100000:2.0:1788305612.719850:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200192 00000100:00080000:0.0:1788305612.719906:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305612.719942:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305612.719956:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994200192:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788305612.720257:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994200192:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 303us (512us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788305612.720267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:3.0:1788305612.723776:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.723939:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200448 00000100:00100000:1.0:1788305612.723958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200448 00000100:00100000:1.0:1788305612.724015:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788305612.724025:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:11394:x1875173994200448:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788305612.724406:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:11394:x1875173994200448:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 379us (639us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788305612.724415:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:1.0:1788305612.729648:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.729773:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200704 00000100:00100000:0.0:1788305612.729788:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200704 00000100:00100000:0.0:1788305612.729943:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:0.0:1788305612.729957:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:11394:x1875173994200704:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788305612.730135:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:11394:x1875173994200704:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 181us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.730143:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:3.0:1788305612.733155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.734193:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200832 00000100:00100000:1.0:1788305612.734209:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200832 00000100:00100000:1.0:1788305612.734340:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:1.0:1788305612.734352:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:11394:x1875173994200832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305612.734384:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.734532:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053e04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08560 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.734703:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.734723:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.734737:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305612.734799:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305612.734941:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.734977:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053e04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08560 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.734999:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08560 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.735010:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:1.0:1788305612.735013:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788305612.735018:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305612.735132:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:11394:x1875173994200832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 781us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.735155:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:3.0:1788305612.738736:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.738855:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994200960 00000100:00100000:2.0:1788305612.738885:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994200960 00000100:00100000:2.0:1788305612.738961:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:2.0:1788305612.738974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994200960:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.738999:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305612.739023:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08567 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305612.739050:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9760cc, blocks: 0x0 00010000:00010000:2.0:1788305612.739084:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=442s v=(0 0) 00010000:00010000:2.0:1788305612.739091:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305612.739103:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.739129:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 10 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.739146:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea800, rc 0) 00000100:00100000:2.0:1788305612.739232:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2396:x1875173994200960:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 260us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.739240:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788305612.741846:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.742098:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201216 00000100:00100000:2.0:1788305612.742112:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201216 00000100:00100000:2.0:1788305612.742244:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:2.0:1788305612.742257:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:11394:x1875173994201216:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788305612.742448:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:11394:x1875173994201216:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 193us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.742477:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:3.0:1788305612.745155:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.745367:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201344 00000100:00100000:1.0:1788305612.745380:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201344 00000100:00100000:1.0:1788305612.745458:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:1.0:1788305612.745469:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:11394:x1875173994201344:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305612.745494:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.745521:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0856e expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.745575:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.745585:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305612.745590:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305612.745595:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.745638:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.745654:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.745671:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015244416:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305612.745791:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305612.749733:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015244416:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305612.749787:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.749814:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51200, rc 0) 00000100:00100000:1.0:1788305612.749908:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:11394:x1875173994201344:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 4439us (4767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.749930:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:3.0:1788305612.750456:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.750505:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201472 00000100:00100000:3.0:1788305612.750516:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201472 00010000:00010000:3.0:1788305612.750564:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.750601:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:3.0:1788305612.750625:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2395:x1875173994201472:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.750649:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.750679:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.750697:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.750753:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4f02b9/0x4a426866e6053e12 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08567 expref: 11 pid: 8436 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.750774:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305612.750779:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305612.750789:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.750801:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.750849:0:7471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.750866:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7471:1875174015244544:192.168.202.55@tcp:105: 00000100:00100000:3.0:1788305612.751570:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.758355:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7471:1875174015244544:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305612.758401:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305612.758475:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2395:x1875173994201472:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 7850us (8018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.758489:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:3.0:1788305612.760739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.761676:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201600 00000100:00100000:2.0:1788305612.761691:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201600 00002000:00100000:2.0:1788305612.761779:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8891bfaa4380 x1875173994201600/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:543/0 lens 504/0 e 0 to 0 dl 1788305623 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305612.761794:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bfaa4380 with x1875173994201600 ext(0->12) 00002000:00010000:2.0:1788305612.761808:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bfaa4380 00000100:00100000:2.0:1788305612.762722:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305612.762744:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2395:x1875173994201600:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788305612.765618:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:2395:x1875173994201600:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 2866us (4884us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788305612.765636:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00002000:00100000:2.0:1788305612.765649:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8891bfaa4380 x1875173994201600/t4294967309(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:543/0 lens 504/448 e 0 to 0 dl 1788305623 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305612.765662:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bfaa4380 with x1875173994201600 ext(0->12) 00002000:00010000:2.0:1788305612.765670:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bfaa4380 00000100:00100000:2.0:1788305612.768770:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.768986:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201728 00000100:00100000:1.0:1788305612.768999:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201728 00000100:00100000:1.0:1788305612.769086:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:1.0:1788305612.769099:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:11394:x1875173994201728:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788305612.774511:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:1.0:1788305612.774546:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788305612.774567:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8891bb0aed80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1788305612.774571:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2dd300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8891bb0ae480 00000020:00080000:1.0:1788305612.774574:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2dda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8891862cbe00 00000004:00080000:1.0:1788305612.774611:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788305612.774667:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8890837680c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1788305612.774671:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889081087d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8890837689c0 00000020:00080000:1.0:1788305612.774674:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889081087c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff88918be30800 00000100:00100000:1.0:1788305612.774802:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015244672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788305612.774883:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305612.774931:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305612.774949:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015244800:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788305612.774973:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788305612.774979:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1788305612.775010:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015244672 00000100:00100000:1.0:1788305612.775017:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015244672 00000100:00100000:1.0:1788305612.775051:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015244800 00000100:00100000:1.0:1788305612.775054:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015244800 00000100:00100000:1.0:1788305612.775102:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305612.775112:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3647:x1875174015244672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788305612.775146:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:1.0:1788305612.775191:0:8436:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9760cb, atime: 0x6a9760cb, ctime: 0x6a9760cb, blocks: 0x8 00010000:00010000:1.0:1788305612.775203:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788305612.775218:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:1.0:1788305612.775224:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=442s v=(0 0) 00010000:00010000:1.0:1788305612.775233:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305612.775240:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775256:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775267:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775316:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775333:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788305612.775473:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3647:x1875174015244672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 361us (589us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788305612.775481:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305612.775505:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788305612.775516:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015244800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788305612.775532:0:8436:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1788305612.775547:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775560:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305612.775563:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775571:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775577:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788305612.775597:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305612.775598:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305612.775607:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775611:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775634:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775643:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 11 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775664:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.775664:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 11 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.775706:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053e20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.775716:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015244928:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305612.775739:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305612.775744:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305612.775747:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305612.775795:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb0ae300 going to sleep for 11 seconds 00000100:00080000:1.0:1788305612.775812:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788305612.775855:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8890836cb800/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788305612.775862:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015244672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788305612.775954:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11394:x1875173994201728:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 6858us (7199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.775962:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 136 00010000:00010000:0.0:1788305612.776258:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776268:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776323:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776329:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776333:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776341:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776355:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8890825b7d00) 00010000:00010000:0.0:1788305612.776358:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.776363:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776369:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6053b1e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776393:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776400:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776405:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776410:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776413:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776429:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776437:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff88908362ed00) 00010000:00010000:0.0:1788305612.776439:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.776442:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776448:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053bc6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776465:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776471:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776477:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776482:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776485:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776491:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776507:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:0.0:1788305612.776509:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.776512:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776524:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053c44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776534:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776540:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776545:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776550:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776552:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776558:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776564:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0100) 00010000:00010000:0.0:1788305612.776566:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.776569:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776574:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053c67 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776593:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776598:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776615:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776620:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776623:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776628:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776635:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.776637:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305612.776640:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776645:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053d39 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776654:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776659:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776664:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776669:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.776671:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776683:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776690:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:0.0:1788305612.776692:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788305612.776694:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.776699:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053df6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.779453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.779695:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201856 00000100:00100000:1.0:1788305612.779705:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201856 00000100:00100000:1.0:1788305612.779767:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788305612.779777:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:2396:x1875173994201856:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788305612.780613:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.780702:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015244928:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305612.780729:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.781147:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994201984 00000100:00100000:3.0:1788305612.781154:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994201984 00010000:00010000:3.0:1788305612.781190:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 13 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.781225:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:3.0:1788305612.781234:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2396:x1875173994201984:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.781246:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.781252:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 13 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.781265:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 13 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.781335:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009830e43d/0x4a426866e6053bd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084c6 expref: 13 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.781353:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305612.781358:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305612.781364:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.781374:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.781403:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.781463:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:2396:x1875173994201984:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 229us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.781471:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00010000:00010000:2.0:1788305612.781651:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781663:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781689:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781696:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781715:0:8436:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788305612.781889:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3647:x1875174015244800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6376us (6913us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788305612.781898:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:2.0:1788305612.781921:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305612.781928:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781937:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305612.781941:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781950:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781964:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781971:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c30513ac/0x4a426866e6053e27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.781997:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305612.781999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305612.782000:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788305612.782040:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891903d4380/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788305612.782054:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015244800:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788305612.786115:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788305612.786140:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788305612.786755:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994201856:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 6973us (7306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.786767:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:0.0:1788305612.789826:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.790907:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994202240 00000100:00100000:1.0:1788305612.790925:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994202240 00000100:00100000:1.0:1788305612.791218:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:1.0:1788305612.791237:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11394:x1875173994202240:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788305612.791391:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305612.791428:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053e0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08560 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.791452:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:1.0:1788305612.791482:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305612.791524:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.791541:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.791620:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305612.791765:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001d17797a reply state 000000001d685fcc transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.791776:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.791780:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:1.0:1788305612.791782:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305612.791785:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305612.793586:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11394:x1875173994202240:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 2341us (3761us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788305612.793602:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:2.0:1788305612.796796:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.797578:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994202368 00000100:00100000:1.0:1788305612.797593:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994202368 00000100:00100000:1.0:1788305612.797665:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:1.0:1788305612.797679:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994202368:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788305612.797887:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788305612.797892:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788305612 00002000:00010000:1.0:1788305612.797895:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788305611 00002000:00010000:1.0:1788305612.797897:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788305612 -> 1788305612 00002000:00010000:1.0:1788305612.797923:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788305612.797999:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994202368:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 323us (1219us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788305612.798008:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788305612.800453:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.800861:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994202624 00000100:00100000:2.0:1788305612.800875:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994202624 00000100:00100000:2.0:1788305612.800960:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:2.0:1788305612.800973:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:11394:x1875173994202624:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.801084:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.801108:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.801119:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.801165:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.801181:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 17 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.801198:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015245056:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305612.801514:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.806792:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.806861:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994202752 00000100:00100000:3.0:1788305612.806874:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994202752 00010000:00010000:3.0:1788305612.806944:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 18 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.807085:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015245056:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305612.807108:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 75 00010000:00010000:2.0:1788305612.807119:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.807120:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2396:x1875173994202752:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.807162:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.807171:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 18 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807185:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 18 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807213:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6053def lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08552 expref: 18 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807235:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:3.0:1788305612.807240:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807252:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807260:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.807349:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.807438:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:2396:x1875173994202752:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 319us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.807446:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 75 00010000:00010000:1.0:1788305612.807573:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807583:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807638:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807646:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807654:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807660:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.807666:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807674:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807684:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:1.0:1788305612.807687:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788305612.807690:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.807696:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053e35 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.807751:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11394:x1875173994202624:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 6781us (7313us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788305612.807760:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:2.0:1788305612.810959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.811090:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994202880 00000100:00100000:1.0:1788305612.811106:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994202880 00000100:00100000:1.0:1788305612.811329:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788305612.811343:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994202880:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788305612.811405:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.811432:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.811441:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305612.811446:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305612.811451:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.811501:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 7 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.811519:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 7 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.811536:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015245184:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305612.811743:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837686c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.817942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.818507:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203008 00000100:00100000:3.0:1788305612.818523:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203008 00010000:00010000:3.0:1788305612.818590:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 8 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.818662:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 76 00000100:00100000:3.0:1788305612.818674:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994203008:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.818693:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.818719:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 8 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.818735:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 8 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.818767:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305612.818772:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305612.818780:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.818792:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.818818:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.818898:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994203008:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 226us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.818907:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 76 00010000:00010000:2.0:1788305612.819436:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a19e5b1e/0x4a426866e6053e19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0856e expref: 7 pid: 8437 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.819458:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015245184:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305612.819486:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819498:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819506:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819531:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819550:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819559:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819583:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305612.819588:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819598:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819614:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.819622:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041eebd54/0x4a426866e6053e3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.819682:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994202880:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 8344us (8738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.819691:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788305612.821786:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.821979:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203264 00000100:00100000:2.0:1788305612.821991:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203264 00000100:00100000:2.0:1788305612.822092:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:2.0:1788305612.822105:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:11394:x1875173994203264:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788305612.822217:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.822240:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.822292:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.822341:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305612.822358:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 16 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305612.822376:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245312:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305612.822561:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889186965840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.827133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.827228:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203392 00000100:00100000:3.0:1788305612.827240:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203392 00010000:00010000:3.0:1788305612.827349:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 17 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.827427:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:3.0:1788305612.827440:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:2396:x1875173994203392:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.827464:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.827473:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 17 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827489:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 17 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827520:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.827528:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 17 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827540:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827563:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827572:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.827599:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.827675:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:2396:x1875173994203392:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 238us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.827684:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00010000:00010000:0.0:1788305612.829407:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053d32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0851a expref: 16 pid: 6519 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.829438:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245312:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.829469:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829480:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829486:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829890:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829908:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829919:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.829991:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.830014:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 16 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.830032:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245440:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305612.830485:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.835615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305612.835816:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203520 00000100:00100000:3.0:1788305612.835850:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203520 00010000:00010000:3.0:1788305612.835910:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 17 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305612.835970:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788305612.835983:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:2396:x1875173994203520:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305612.836007:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305612.836015:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 17 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.836030:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 17 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.836061:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:3.0:1788305612.836078:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.836090:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.836099:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.836124:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305612.836211:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+17:2396:x1875173994203520:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 230us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305612.836219:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00010000:00010000:0.0:1788305612.837802:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6053dfd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08559 expref: 16 pid: 6520 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.837948:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245440:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305612.837979:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.837990:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.837997:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305612.838259:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788305612.838456:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788305612.838499:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788305612.838894:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015245568:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305612.838984:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305612.839032:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082568cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.839117:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015245568 00000100:00100000:2.0:1788305612.839126:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015245568 00000100:00100000:2.0:1788305612.839333:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788305612.839346:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015245568:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788305612.839454:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015245568:12345-0@lo:1000:mdt00_000.0 Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.839463:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788305612.839569:0:6519:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788305612.839577:0:6519:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88918caa8700, transno 4294967304 00000004:00080000:0.0:1788305612.839589:0:6519:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788305612.839617:0:6519:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8891903d4380 x1875174015244800/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305628 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305612.839629:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015245568:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788305612.839799:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788305612.839871:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015245696:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788305612.839905:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305612.840808:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825689c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305612.840940:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015245696 00000100:00100000:3.0:1788305612.840948:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015245696 00000100:00100000:3.0:1788305612.841018:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788305612.841028:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875174015245696:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788305612.841296:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875174015245696:12345-0@lo:1000:mdt00_000.0 Request processed in 249us (1369us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788305612.841306:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788305612.841453:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6519:1875174015245696:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788305612.841514:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841527:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841536:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841554:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.841570:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841580:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841603:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:0.0:1788305612.841606:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305612.841612:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841619:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e4a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841648:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841655:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841661:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841667:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305612.841670:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841676:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841684:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.841687:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305612.841701:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841715:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841725:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.841762:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.841778:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245824:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788305612.841873:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305612.845632:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305612.846040:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203648 00000100:00100000:2.0:1788305612.846054:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203648 00000100:00100000:2.0:1788305612.846148:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:2.0:1788305612.846161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11393:x1875173994203648:12345-192.168.202.55@tcp:49:lfs.0 00000100:00100000:2.0:1788305612.846371:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:11393:x1875173994203648:12345-192.168.202.55@tcp:49:lfs.0 Request processed in 212us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305612.846400:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:3.0:1788305612.848025:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6519:1875174015245824:192.168.202.55@tcp:105: 00010000:00010000:3.0:1788305612.848076:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848090:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053d8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848137:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848153:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848167:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848180:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848186:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848193:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848200:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305612.848219:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848228:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848242:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.848246:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305612.848250:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848256:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e51 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848266:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848323:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848331:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848336:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305612.848339:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848346:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848354:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305612.848356:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305612.848367:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.848373:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053e43 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305612.849440:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305612.849451:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305612.850501:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788305612.850518:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305612.851095:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11394:x1875173994203264:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 28981us (29312us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788305612.851112:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 139 00000020:00080000:1.0:1788305612.851122:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788305612.851306:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.853075:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994203904 00000100:00100000:1.0:1788305612.853096:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994203904 00000100:00100000:1.0:1788305612.853204:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:1.0:1788305612.853217:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11393:x1875173994203904:12345-192.168.202.55@tcp:58:lfs.0 00000040:00080000:1.0:1788305612.853506:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788305612.853838:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11393:x1875173994203904:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 613us (2554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.853847:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:2.0:1788305612.857171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.862921:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994204160 00000100:00100000:0.0:1788305612.862945:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994204160 00000100:00100000:0.0:1788305612.863113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:0.0:1788305612.863128:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:11394:x1875173994204160:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788305612.863587:0:6522:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788305612.863634:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788305612.863677:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863698:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863713:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863742:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863749:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863756:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.863783:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788305612.863932:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:11394:x1875173994204160:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 806us (6785us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788305612.863941:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000020:00080000:0.0:1788305612.863947:0:6522:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788305612.865306:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305612.865320:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.865331:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305612.865336:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.865345:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.865366:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:3.0:1788305612.865369:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788305612.865375:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.865383:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305612.865403:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305612.865405:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305612.865407:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305612.890823:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305612.895260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.895629:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994204288 00000100:00100000:1.0:1788305612.895643:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994204288 00000100:00100000:1.0:1788305612.895723:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:1.0:1788305612.895737:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:11396:x1875173994204288:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305612.895771:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305612.895800:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053e5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08575 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.895951:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.895972:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.895986:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896029:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896038:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896045:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896487:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896503:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896513:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896629:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.896648:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 22 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305612.896666:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015245952:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305612.896792:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305612.899723:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305612.899866:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015245952:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305612.899902:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.900041:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994204544 00000100:00100000:0.0:1788305612.900051:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994204544 00000100:00100000:0.0:1788305612.900178:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:0.0:1788305612.900191:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:6168:x1875173994204544:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788305612.900912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:6168:x1875173994204544:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 719us (1198us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788305612.900923:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:2.0:1788305612.904414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305612.904534:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994204672 00000100:00100000:0.0:1788305612.904621:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994204672 00010000:00010000:0.0:1788305612.904683:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 24 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305612.904777:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:0.0:1788305612.904813:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:2396:x1875173994204672:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305612.904906:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305612.904917:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 24 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.904934:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 24 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.904964:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e6053d7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08536 expref: 24 pid: 10615 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.904986:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305612.904992:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.905005:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.905014:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305612.905055:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305612.905251:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:2396:x1875173994204672:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 440us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305612.905260:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00010000:00010000:1.0:1788305612.905443:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905454:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305612.905530:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788305612.905535:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305612.905574:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905591:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905602:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905609:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905617:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905624:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.905629:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905637:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905650:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305612.905665:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305612.905670:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905677:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053e66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905691:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905698:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905703:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905708:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305612.905711:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905717:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905726:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff88918c7b0500) 00010000:00010000:1.0:1788305612.905729:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305612.905732:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905738:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053e6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905783:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053e5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08575 expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905817:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08575 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305612.905835:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305612.905838:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305612.905841:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51000, rc 0) 00000100:00100000:1.0:1788305612.905878:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11396:x1875173994204288:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 10144us (10634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305612.905886:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 141 00000001:00080000:2.0:1788305613.406376:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1788305613.406399:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:2.0:1788305613.692626:0:14270:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305613.692637:0:14270:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305613.692686:0:14270:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788305613.692694:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788305613.909845:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305613.914833:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305613.914849:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305613.914885:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788305613.914894:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305613.915115:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015246080:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305613.915520:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f613c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305613.917767:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015246080:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788305613.921430:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305613.922334:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994204800 00000100:00100000:2.0:1788305613.922350:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994204800 00000100:00100000:2.0:1788305613.922618:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:2.0:1788305613.922632:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11408:x1875173994204800:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305613.922682:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305613.923600:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11408:x1875173994204800:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 965us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305613.923612:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00080000:1.0:1788305613.931449:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305613.935649:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305613.935762:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994205056 00000100:00100000:0.0:1788305613.935799:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994205056 00000100:00100000:0.0:1788305613.935876:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:0.0:1788305613.935889:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:11408:x1875173994205056:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305613.935914:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305613.935941:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6053e7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0857c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.936111:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.936130:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.936147:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305613.936160:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788305613.936327:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6053e7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0857c expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.936347:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0857c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.936357:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305613.936361:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305613.936365:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9200, rc 0) 00000100:00100000:0.0:1788305613.936455:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:11408:x1875173994205056:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 568us (822us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788305613.936464:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:3.0:1788305613.945268:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305613.945371:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305613.945418:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994205440 00000100:00100000:3.0:1788305613.945431:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994205440 00000100:00100000:3.0:1788305613.945513:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305613.945527:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:2396:x1875173994205440:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305613.945549:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305613.945583:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e6053e82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0857c expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305613.945608:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305613.945614:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305613.945685:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:2396:x1875173994205440:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 161us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305613.945694:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:0.0:1788305613.946033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994205312 00000100:00100000:0.0:1788305613.946040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994205312 00000100:00100000:0.0:1788305613.946097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:0.0:1788305613.946105:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:11408:x1875173994205312:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788305613.946203:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946235:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946470:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946479:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946486:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946492:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305613.946497:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946505:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946517:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:0.0:1788305613.946520:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305613.946540:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305613.946546:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e6053e90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305613.946663:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:11408:x1875173994205312:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 558us (1409us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788305613.946672:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 144 00000040:00080000:0.0:1788305613.948581:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305613.948593:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305613.954469:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788305613.954505:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305613.958861:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305613.959072:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994205696 00000100:00100000:2.0:1788305613.959086:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994205696 00000100:00100000:2.0:1788305613.959166:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:2.0:1788305613.959180:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:11408:x1875173994205696:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788305613.959561:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:11408:x1875173994205696:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 382us (711us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788305613.959570:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:3.0:1788305614.933516:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788305615.317554:0:8755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445408275693ns, next at 446408271791ns, rc = 0 00000100:00100000:2.0:1788305615.317644:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015246208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305615.317725:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305615.318102:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015246336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305615.318138:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305615.318174:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305615.318182:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015246464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305615.318208:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305615.318238:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246208 00000100:00100000:1.0:1788305615.318246:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246208 00000100:00100000:1.0:1788305615.318317:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246336 00000100:00100000:1.0:1788305615.318321:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246336 00000100:00100000:1.0:1788305615.318336:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246464 00000100:00100000:1.0:1788305615.318339:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246464 00000100:00100000:1.0:1788305615.318355:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788305615.318364:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875174015246208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305615.318394:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788305615.318436:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3649:x1875174015246208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305615.318460:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788305615.318477:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788305615.318482:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015246336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305615.318492:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788305615.318520:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015246336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305615.318526:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788305615.318537:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788305615.318543:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015246464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305615.318557:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305615.318586:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015246464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305615.318593:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1788305615.318611:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305615.318615:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305615.318637:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788305615.318643:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:1.0:1788305615.318663:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8890836d4a80, transno 4294967302 00000004:00080000:1.0:1788305615.318671:0:3648:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1788305615.318680:0:3648:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8890836cb800, transno 4294967305 00000100:00100000:1.0:1788305615.318691:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015246464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305615.318714:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015246336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305615.319037:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015246208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305615.319191:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015246976:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305615.319248:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015247488:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305615.319334:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788305615.319340:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015246592:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305615.319390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015247104:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319414:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305615.319432:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015247616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305615.319477:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246592 00000100:00100000:2.0:1788305615.319483:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246592 00000100:00100000:2.0:1788305615.319519:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788305615.319525:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015246592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319561:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015246592:12345-0@lo:400:kworker.0 Request processed in 36us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305615.319568:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788305615.319606:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247104 00000100:00100000:2.0:1788305615.319610:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247104 00000100:00100000:2.0:1788305615.319648:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788305615.319656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015247104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.319690:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015247104:12345-0@lo:400:kworker.0 Request processed in 36us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305615.319695:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788305615.319712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246976 00000100:00100000:2.0:1788305615.319715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246976 00000100:00100000:2.0:1788305615.319738:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247488 00000100:00100000:2.0:1788305615.319741:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247488 00000100:00100000:2.0:1788305615.319757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247616 00000100:00100000:2.0:1788305615.319759:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247616 00000100:00100000:2.0:1788305615.319772:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788305615.319778:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015246976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.320204:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788305615.320215:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015247488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.320227:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015246976:12345-0@lo:400:kworker.0 Request processed in 449us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305615.320234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788305615.320247:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788305615.320251:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015247488:12345-0@lo:400:kworker.0 Request processed in 39us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305615.320253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015247616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.320257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788305615.320298:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015247616:12345-0@lo:400:kworker.0 Request processed in 44us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305615.320304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788305615.320337:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015246848:0@lo:400:kworker.0 00000100:00080000:1.0:1788305615.320367:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305615.320367:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305615.320372:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305615.320383:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246848 00000100:00100000:0.0:1788305615.320387:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015247360:0@lo:400:kworker.0 00000100:00100000:1.0:1788305615.320395:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246848 00000100:00100000:0.0:1788305615.320407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305615.320423:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788305615.320430:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015246720:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.320451:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305615.331055:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788305615.331079:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015246848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305615.331178:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015246848:12345-0@lo:400:kworker.0 Request processed in 111us (10809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305615.331185:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788305615.331294:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305615.331307:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015247872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305615.331350:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305615.331388:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247872 00000100:00100000:1.0:1788305615.331394:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247872 00000100:00100000:1.0:1788305615.331437:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788305615.331444:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891c052ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015247872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305615.331459:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305615.331494:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891c052ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015247872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305615.331500:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1788305615.331684:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305615.331718:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015247872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305615.335532:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015247232:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.335598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305615.338621:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247360 00000100:00100000:3.0:1788305615.338648:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247360 00000100:00100000:3.0:1788305615.338714:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015246720 00000100:00100000:3.0:1788305615.338717:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015246720 00000100:00100000:3.0:1788305615.338728:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247232 00000100:00100000:3.0:1788305615.338730:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247232 00000100:00100000:3.0:1788305615.338750:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788305615.338759:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015247360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339406:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015247744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339469:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305615.339517:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015246848:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339555:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015247744 00000100:00100000:0.0:1788305615.339560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015247744 00000100:00100000:0.0:1788305615.339598:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305615.339607:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015247744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339711:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015247744:12345-0@lo:400:kworker.0 Request processed in 105us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305615.339719:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305615.339761:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788305615.339771:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015246720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339807:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015246720:12345-0@lo:400:kworker.0 Request processed in 38us (19355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305615.339814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788305615.339830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788305615.339836:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015247232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339867:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015247232:12345-0@lo:400:kworker.0 Request processed in 31us (4269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305615.339873:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788305615.339904:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015246720:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339915:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015247232:0@lo:400:kworker.0 00000100:00100000:0.0:1788305615.339940:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083edb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015247744:0@lo:400:kworker.0 00000100:00080000:0.0:1788305615.340493:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305615.340499:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305615.342939:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015247360:12345-0@lo:400:kworker.0 Request processed in 4173us (22521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305615.342953:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788305615.344973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015246592:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.344991:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015247104:0@lo:400:kworker.0 00010000:00080000:2.0:1788305615.345743:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083ed8000 x1875174015247616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305615.345772:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015247616:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.345785:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015246976:0@lo:400:kworker.0 00000100:00100000:2.0:1788305615.345796:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015247488:0@lo:400:kworker.0 00010000:00080000:0.0:1788305615.348295:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836c8000 x1875174015247360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305615.348314:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015247360:0@lo:400:kworker.0 00000040:00080000:0.0:1788305615.824200:0:14321:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305615.824209:0:14321:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305615.824241:0:14321:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788305615.824249:0:14321:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788305615.957642:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305616.095252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305616.095320:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994205952 00000100:00100000:3.0:1788305616.095329:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994205952 00000100:00100000:3.0:1788305616.095393:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:3.0:1788305616.095403:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:11429:x1875173994205952:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305616.095426:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305616.095447:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053e97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08583 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305616.095558:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e9e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305616.095574:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305616.095585:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305616.095597:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788305616.095702:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053e97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08583 expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305616.095717:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08583 expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305616.095742:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:3.0:1788305616.095745:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788305616.095749:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a200, rc 0) 00000100:00100000:3.0:1788305616.095804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:11429:x1875173994205952:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 402us (561us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788305616.095812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00080000:3.0:1788305616.095836:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305616.101656:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305616.102136:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206080 00000100:00100000:2.0:1788305616.102146:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206080 00000100:00100000:2.0:1788305616.102233:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:2.0:1788305616.102243:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:11429:x1875173994206080:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788305616.102347:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102367:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102377:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102416:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102422:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102429:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102435:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305616.102439:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102461:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102474:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:2.0:1788305616.102477:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305616.102482:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.102488:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6053eac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305616.102570:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:11429:x1875173994206080:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 327us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305616.102578:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:3.0:1788305616.224113:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305616.224238:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206208 00000100:00100000:2.0:1788305616.224249:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206208 00000100:00100000:2.0:1788305616.224372:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788305616.224383:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2397:x1875173994206208:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788305616.224402:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305616.224424:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6053eb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0858a expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305616.224451:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9760cc, atime: 0x6a9760cb, ctime: 0x6a9760cc, blocks: 0x8 00010000:00010000:2.0:1788305616.224471:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1788305616.224476:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305616.224486:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6053eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0858a expref: 7 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.224541:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6053eb3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0858a expref: 7 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305616.224556:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305616.224624:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2397:x1875173994206208:12345-192.168.202.55@tcp:101:cat.0 Request processed in 243us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305616.224631:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00080000:3.0:1788305616.224893:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305616.229081:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305616.229351:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206336 00000100:00100000:2.0:1788305616.229362:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206336 00002000:00100000:2.0:1788305616.229416:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff889083d19880 x1875173994206336/t0(0) o3->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:547/0 lens 488/0 e 0 to 0 dl 1788305627 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305616.229427:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083d19880 with x1875173994206336 ext(0->4095) 00002000:00010000:2.0:1788305616.229433:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889083d19880 00000100:00100000:2.0:1788305616.229463:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305616.229474:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994206336:12345-192.168.202.55@tcp:3:cat.0 00000100:00100000:2.0:1788305616.229663:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994206336:12345-192.168.202.55@tcp:3:cat.0 Request processed in 190us (594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788305616.229671:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00002000:00100000:2.0:1788305616.229678:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff889083d19880 x1875173994206336/t0(0) o3->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:547/0 lens 488/4536 e 0 to 0 dl 1788305627 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305616.229686:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083d19880 with x1875173994206336 ext(0->4095) 00002000:00010000:2.0:1788305616.229689:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889083d19880 00010000:00010000:1.0:1788305616.986861:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305617.367823:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305617.367848:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015248000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305617.367998:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305617.368077:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248000 00000100:00100000:3.0:1788305617.368086:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248000 00000100:00100000:3.0:1788305617.368134:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788305617.368144:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015248000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305617.368177:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788305617.368229:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015248000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.368237:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788305617.368938:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305617.368979:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015248128:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305617.369018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305617.369099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248128 00000100:00100000:2.0:1788305617.369103:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248128 00000100:00100000:2.0:1788305617.369133:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788305617.369140:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015248128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305617.369160:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788305617.369199:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015248128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305617.369205:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788305617.369239:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015248128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305617.369598:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015248000:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305617.521514:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521577:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521611:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521629:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521666:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305617.521696:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206464 00000100:00100000:3.0:1788305617.521705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206464 00000100:00100000:3.0:1788305617.521756:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 389 00000100:00100000:3.0:1788305617.521767:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994206464:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.521857:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994206464:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 91us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.521865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 389 00000100:00100000:3.0:1788305617.521898:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206720 00000100:00100000:3.0:1788305617.521901:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206720 00000100:00100000:3.0:1788305617.521929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207232 00000100:00100000:3.0:1788305617.521932:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207232 00000100:00100000:3.0:1788305617.521945:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206592 00000100:00100000:3.0:1788305617.521948:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206592 00000100:00100000:3.0:1788305617.521958:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207104 00000100:00100000:3.0:1788305617.521960:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207104 00000100:00100000:3.0:1788305617.521977:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 320 00000100:00100000:3.0:1788305617.521984:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994206720:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522015:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994206720:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522031:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 320 00000100:00100000:3.0:1788305617.522046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 321 00000100:00100000:3.0:1788305617.522052:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994207232:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522077:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994207232:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 321 00000100:00100000:3.0:1788305617.522106:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 322 00000100:00100000:3.0:1788305617.522112:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:2396:x1875173994206592:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522138:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:2396:x1875173994206592:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 322 00000100:00100000:3.0:1788305617.522155:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 323 00000100:00100000:3.0:1788305617.522162:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994207104:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522184:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994207104:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 323 00000100:00100000:3.0:1788305617.522209:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206976 00000100:00100000:3.0:1788305617.522213:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206976 00000100:00100000:3.0:1788305617.522240:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994206848 00000100:00100000:3.0:1788305617.522243:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994206848 00000100:00100000:3.0:1788305617.522264:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:3.0:1788305617.522270:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994206976:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522324:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994206976:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 54us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522331:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:3.0:1788305617.522344:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788305617.522350:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994206848:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305617.522372:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994206848:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305617.522384:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00080000:3.0:1788305617.522411:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305617.522416:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305617.522418:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788305618.005443:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305618.073593:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305618.073604:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305618.073623:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788305618.073633:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788305618.581892:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788305618.905893:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:1.0:1788305618.905913:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1788305618.905967:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889082568cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788305618.905973:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb492900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8890825683c0 00000020:00080000:1.0:1788305618.905976:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb492c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8890836e5000 00000020:00080000:1.0:1788305618.906002:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:2.0:1788305618.906314:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015248256:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305618.906380:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305618.906461:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248256 00000100:00100000:2.0:1788305618.906469:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248256 00000100:00100000:2.0:1788305618.906530:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788305618.906539:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3649:x1875174015248256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788305618.906674:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788305618.906678:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788305612 -> 1788305612 00002000:00010000:2.0:1788305618.906680:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788305611 -> 1788305611 00002000:00010000:2.0:1788305618.906682:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788305612 -> 1788305612 00002000:00010000:2.0:1788305618.906684:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788305618.906739:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3649:x1875174015248256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 200us (358us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788305618.906747:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788305618.906767:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788305618.906814:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff889083ed9f80/2, rc 0, transno 4294967313 00000100:00100000:2.0:1788305618.906820:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015248256:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1788305618.907168:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788305618.907230:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1788305618.907423:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907435:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907443:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907449:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305618.907455:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907462:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907478:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff889186383500) 00010000:00010000:3.0:1788305618.907481:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305618.907486:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305618.907492:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e6053e2e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305618.908827:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788305618.908841:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:3.0:1788305619.029866:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305620.055307:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305620.437827:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015248384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305620.437898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.438123:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015248512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305620.438130:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248384 00000100:00100000:0.0:1788305620.438139:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248384 00000100:00100000:2.0:1788305620.438156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.438187:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305620.438194:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015248640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305620.438195:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248512 00000100:00100000:0.0:1788305620.438200:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248512 00000100:00100000:2.0:1788305620.438224:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305620.438228:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788305620.438244:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305620.438253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015248384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305620.438303:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305620.438362:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015248384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305620.438369:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788305620.438384:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248640 00000100:00100000:0.0:1788305620.438388:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248640 00000100:00100000:0.0:1788305620.438410:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305620.438416:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015248512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305620.438441:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305620.438471:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015248512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305620.438477:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788305620.438489:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788305620.438496:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015248640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305620.438511:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788305620.438538:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015248640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305620.438544:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:2.0:1788305620.439031:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305620.439048:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015249024:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439113:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015249536:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439137:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439166:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788305620.439171:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891903d4380, transno 4294967310 00000004:00080000:2.0:1788305620.439182:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788305620.439204:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff889083ed9f80 x1875174015248256/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788305634 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305620.439223:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015248640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305620.439252:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015248512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305620.439267:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788305620.439307:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015249152:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439348:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015249664:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439491:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015248896:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439519:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439533:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015249408:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439565:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015249920:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439735:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015248384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305620.439751:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788305620.439756:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015248768:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.439950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.439977:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015249280:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.440015:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.440034:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015249792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.440054:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305620.440078:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249024 00000100:00100000:2.0:1788305620.440084:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249024 00000100:00100000:2.0:1788305620.440118:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249280 00000100:00100000:2.0:1788305620.440122:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249280 00000100:00100000:2.0:1788305620.440135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788305620.440142:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015249024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.440189:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015249024:12345-0@lo:400:kworker.0 Request processed in 47us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305620.440204:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788305620.440218:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788305620.440223:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015249280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.440352:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015249280:12345-0@lo:400:kworker.0 Request processed in 127us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305620.440358:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788305620.440387:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015249024:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.440410:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015249280:0@lo:400:kworker.0 00000100:00100000:0.0:1788305620.440500:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248768 00000100:00100000:0.0:1788305620.440504:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248768 00000100:00100000:0.0:1788305620.440543:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788305620.440551:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015248768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305620.440607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af198050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015248768:12345-0@lo:400:kworker.0 Request processed in 56us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305620.440613:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:0.0:1788305620.440650:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015248768:0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.440857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305620.440870:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015250048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305620.440900:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305620.440928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249536 00000100:00100000:3.0:1788305620.440931:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249536 00000100:00100000:3.0:1788305620.440963:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249152 00000100:00100000:3.0:1788305620.440966:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249152 00000100:00100000:3.0:1788305620.440977:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015248896 00000100:00100000:3.0:1788305620.440980:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015248896 00000100:00100000:3.0:1788305620.440989:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249408 00000100:00100000:3.0:1788305620.440992:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249408 00000100:00100000:3.0:1788305620.441022:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249920 00000100:00100000:3.0:1788305620.441025:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249920 00000100:00100000:3.0:1788305620.441037:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249792 00000100:00100000:3.0:1788305620.441040:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249792 00000100:00100000:3.0:1788305620.441052:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788305620.441058:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015249536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441090:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015249536:12345-0@lo:400:kworker.0 Request processed in 32us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441096:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1788305620.441110:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788305620.441116:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015249152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441143:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015249152:12345-0@lo:400:kworker.0 Request processed in 28us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441148:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788305620.441159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788305620.441164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015248896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441191:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015248896:12345-0@lo:400:kworker.0 Request processed in 27us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788305620.441219:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788305620.441225:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015249408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441265:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015249408:12345-0@lo:400:kworker.0 Request processed in 40us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441270:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788305620.441301:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788305620.441307:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015249920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441336:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015249920:12345-0@lo:400:kworker.0 Request processed in 29us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441341:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788305620.441352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788305620.441358:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015249792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015249792:12345-0@lo:400:kworker.0 Request processed in 26us (1328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441389:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788305620.441409:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015249664 00000100:00100000:3.0:1788305620.441413:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015249664 00000100:00100000:3.0:1788305620.441437:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305620.441444:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015249664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441473:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015249664:12345-0@lo:400:kworker.0 Request processed in 30us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441478:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788305620.441503:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305620.441507:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305620.441516:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305620.441527:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250048 00000100:00100000:3.0:1788305620.441530:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250048 00000100:00100000:3.0:1788305620.441551:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788305620.441557:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015250048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305620.441570:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788305620.441802:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015249152:0@lo:400:kworker.0 00000100:00100000:2.0:1788305620.441813:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015249664:0@lo:400:kworker.0 00010000:00080000:2.0:1788305620.441826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083755180 x1875174015249536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305620.441835:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083755180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015249536:0@lo:400:kworker.0 00000100:00100000:3.0:1788305620.441913:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015250048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 355us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305620.441920:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788305620.442071:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015250048:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305620.442164:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015249792:0@lo:400:kworker.0 00000100:00100000:0.0:1788305620.442175:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015248896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305620.442185:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015249408:0@lo:400:kworker.0 00010000:00080000:0.0:1788305620.442195:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb484700 x1875174015249920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305620.442203:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015249920:0@lo:400:kworker.0 00010000:00010000:3.0:1788305621.077545:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305622.101963:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305622.122028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305622.122330:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207360 00000100:00100000:0.0:1788305622.122340:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207360 00000100:00100000:0.0:1788305622.122411:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 147 00000100:00100000:0.0:1788305622.122422:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11082:x1875173994207360:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788305622.122541:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11082:x1875173994207360:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 120us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.122549:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 147 00000100:00080000:3.0:1788305622.122994:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305622.127208:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305622.127384:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207488 00000100:00100000:0.0:1788305622.127396:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207488 00000100:00100000:0.0:1788305622.127478:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:0.0:1788305622.127489:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:11082:x1875173994207488:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788305622.127604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:11082:x1875173994207488:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 117us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.127612:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00080000:3.0:1788305622.128044:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305622.134553:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305622.134770:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207744 00000100:00100000:0.0:1788305622.134780:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207744 00000100:00100000:0.0:1788305622.136879:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:0.0:1788305622.136901:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:11082:x1875173994207744:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788305622.137158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083755180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:11082:x1875173994207744:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 265us (2613us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788305622.137166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788305622.485918:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015250176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305622.486009:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305622.486068:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250176 00000100:00100000:0.0:1788305622.486078:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250176 00000100:00100000:0.0:1788305622.486135:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788305622.486145:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015250176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305622.486196:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788305622.486247:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015250176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.486254:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788305622.488353:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015250304:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305622.488417:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305622.488864:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250304 00000100:00100000:2.0:1788305622.488872:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250304 00000100:00100000:2.0:1788305622.488935:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788305622.488944:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015250304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305622.488976:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305622.489036:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015250304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305622.489058:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788305622.489106:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083642300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015250304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305622.490266:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083754000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015250176:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305622.547740:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305622.547859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994207872 00000100:00100000:0.0:1788305622.547870:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994207872 00000100:00100000:0.0:1788305622.547989:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00100000:0.0:1788305622.548000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:11889:x1875173994207872:12345-192.168.202.55@tcp:101:lsof.0 00010000:00010000:0.0:1788305622.548021:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305622.548043:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08591 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548105:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548118:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305622.548194:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305622.548199:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305622.548241:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548267:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548330:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305622.548338:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305622.548341:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305622.548344:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8c00, rc 0) 00000100:00100000:0.0:1788305622.548401:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083642300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:11889:x1875173994207872:12345-192.168.202.55@tcp:101:lsof.0 Request processed in 404us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.548408:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 149 00000100:00080000:3.0:1788305622.549389:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305622.638145:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305622.638214:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305622.638256:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305622.638349:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305622.638377:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305622.638406:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305622.638623:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208256 00000100:00100000:0.0:1788305622.638639:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208256 00000100:00100000:0.0:1788305622.638721:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208128 00000100:00100000:0.0:1788305622.638725:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208128 00000100:00100000:0.0:1788305622.638752:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208640 00000100:00100000:0.0:1788305622.638755:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208640 00000100:00100000:0.0:1788305622.638794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 330 00000100:00100000:0.0:1788305622.638806:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994208256:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305622.638914:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083754000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994208256:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 109us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.638923:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 330 00000100:00100000:0.0:1788305622.638945:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 331 00000100:00100000:0.0:1788305622.638952:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:2395:x1875173994208128:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305622.638999:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:2395:x1875173994208128:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 48us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.639006:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 331 00000100:00100000:0.0:1788305622.639042:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 332 00000100:00100000:0.0:1788305622.639049:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994208640:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305622.639074:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994208640:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305622.639081:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 332 00000100:00100000:1.0:1788305622.639327:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208384 00000100:00100000:1.0:1788305622.639345:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208384 00000100:00100000:1.0:1788305622.639445:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:1.0:1788305622.639458:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994208384:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305622.639543:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994208384:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 87us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305622.639550:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00080000:1.0:1788305622.639593:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305622.639598:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305622.642204:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208512 00000100:00100000:3.0:1788305622.642229:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208512 00000100:00100000:3.0:1788305622.642375:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:3.0:1788305622.642404:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994208512:12345-192.168.202.55@tcp:400:kworker.0 00000100:00080000:1.0:1788305622.642474:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305622.642590:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208000 00000100:00100000:2.0:1788305622.642598:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208000 00000100:00100000:2.0:1788305622.642643:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 391 00000100:00100000:2.0:1788305622.642652:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994208000:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305622.658207:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af199050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994208000:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 15537us (20060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305622.658229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 391 00000100:00100000:3.0:1788305622.663421:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082052d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994208512:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 21001us (25146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305622.663441:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 87 00010000:00010000:1.0:1788305623.125516:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305624.149448:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788305625.046926:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788305625.048159:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1788305625.048174:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1788305625.048268:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788305625.048301:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788305625.174732:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305625.557503:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015250560:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557631:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015251072:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557676:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015251584:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557728:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788305625.557734:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015250688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557803:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015251200:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557824:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557840:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015251712:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.557871:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.557900:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250560 00000100:00100000:1.0:1788305625.557908:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250560 00000100:00100000:1.0:1788305625.557944:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251072 00000100:00100000:1.0:1788305625.557947:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251072 00000100:00100000:1.0:1788305625.557984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251584 00000100:00100000:1.0:1788305625.557987:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251584 00000100:00100000:1.0:1788305625.557999:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251200 00000100:00100000:1.0:1788305625.558001:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251200 00000100:00100000:1.0:1788305625.558013:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251712 00000100:00100000:1.0:1788305625.558015:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251712 00000100:00100000:1.0:1788305625.558029:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788305625.558037:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015250560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558088:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015250560:12345-0@lo:400:kworker.0 Request processed in 51us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558095:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788305625.558110:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788305625.558116:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015251072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558142:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015251072:12345-0@lo:400:kworker.0 Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558147:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788305625.558158:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788305625.558164:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015251584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558187:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015251584:12345-0@lo:400:kworker.0 Request processed in 25us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558193:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788305625.558203:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788305625.558209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015251200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558242:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015251200:12345-0@lo:400:kworker.0 Request processed in 33us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558248:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788305625.558259:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788305625.558264:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015251712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558309:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875174015251712:12345-0@lo:400:kworker.0 Request processed in 45us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558315:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788305625.558338:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250688 00000100:00100000:1.0:1788305625.558341:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250688 00000100:00100000:1.0:1788305625.558364:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788305625.558370:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015250688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558398:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015250688:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.558404:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1788305625.558421:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305625.558424:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305625.558452:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015250688:0@lo:400:kworker.0 00010000:00080000:1.0:1788305625.558466:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88908209fb80 x1875174015251200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305625.558476:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015251200:0@lo:400:kworker.0 00010000:00080000:1.0:1788305625.558484:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890837e8000 x1875174015251712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305625.558492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015251712:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558512:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb484700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015250560:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558519:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb3ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015251072:0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.558526:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015251584:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559007:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015250816:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559041:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559060:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015251328:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559083:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559100:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015251840:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559119:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559153:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788305625.559159:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015250432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559205:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015250944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559226:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559242:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015251456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559260:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559292:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015251968:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559326:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305625.559353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250944 00000100:00100000:3.0:1788305625.559364:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250944 00000100:00100000:3.0:1788305625.559393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788305625.559401:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015250944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559440:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015250944:12345-0@lo:400:kworker.0 Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.559446:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788305625.559465:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251328 00000100:00100000:3.0:1788305625.559468:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251328 00000100:00100000:3.0:1788305625.559490:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251840 00000100:00100000:3.0:1788305625.559492:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251840 00000100:00100000:3.0:1788305625.559502:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251456 00000100:00100000:3.0:1788305625.559504:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251456 00000100:00100000:3.0:1788305625.559514:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015251968 00000100:00100000:3.0:1788305625.559516:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015251968 00000100:00100000:3.0:1788305625.559527:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788305625.559532:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015251328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559561:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015251328:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.559566:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788305625.559578:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788305625.559584:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015251840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559610:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015251840:12345-0@lo:400:kworker.0 Request processed in 27us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.559615:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788305625.559625:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788305625.559630:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015251456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559652:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015251456:12345-0@lo:400:kworker.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.559666:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788305625.559676:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788305625.559681:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015251968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559707:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015251968:12345-0@lo:400:kworker.0 Request processed in 26us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.559712:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788305625.559740:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890826fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015250944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559748:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788305625.559753:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff889083ed9f80, transno 4294967313 00000100:00100000:3.0:1788305625.559778:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015251456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559788:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015251968:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559797:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015251328:0@lo:400:kworker.0 00000100:00100000:3.0:1788305625.559805:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015251840:0@lo:400:kworker.0 00000100:00080000:1.0:1788305625.560066:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305625.560071:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305625.560083:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250816 00000100:00100000:1.0:1788305625.560086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250816 00000100:00100000:1.0:1788305625.560124:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788305625.560132:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015250816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305625.560172:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918356c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015250816:12345-0@lo:400:kworker.0 Request processed in 41us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.560178:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788305625.560203:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015250816:0@lo:400:kworker.0 00000100:00100000:2.0:1788305625.560366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015250432 00000100:00100000:2.0:1788305625.560371:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015250432 00000100:00100000:2.0:1788305625.560397:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788305625.560404:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015250432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305625.560441:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015250432:12345-0@lo:400:kworker.0 Request processed in 38us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305625.560447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788305625.560655:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305625.560667:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015252352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305625.560701:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305625.563136:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015252480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305625.563208:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.563408:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252352 00000100:00100000:1.0:1788305625.563415:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252352 00000100:00100000:1.0:1788305625.563468:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252480 00000100:00100000:1.0:1788305625.563472:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252480 00000100:00100000:1.0:1788305625.563487:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788305625.563495:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015252352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305625.563523:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788305625.563598:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788305625.563609:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015252480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305625.563619:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788305625.570508:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015250432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305625.570553:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015252096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305625.570624:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305625.570651:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305625.570658:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015252224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305625.570680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305625.570928:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015252352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7430us (10223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.570939:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788305625.570975:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252096 00000100:00100000:1.0:1788305625.570981:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252096 00000100:00100000:1.0:1788305625.571018:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252224 00000100:00100000:1.0:1788305625.571021:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252224 00000100:00100000:1.0:1788305625.571034:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788305625.571042:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015252096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788305625.571071:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305625.571124:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015252096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.571129:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788305625.571141:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788305625.571147:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015252224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305625.571156:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305625.571181:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015252224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305625.571186:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788305625.571440:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015252224:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305625.571510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015252096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305625.571667:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015252480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 8059us (8457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305625.571675:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788305625.577502:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890837a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015252480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305625.577554:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015252352:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788305625.896180:0:14518:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:33:44 (1788305624) 00010000:00010000:1.0:1788305626.200239:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305627.221450:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305627.607817:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305627.607859:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305627.607966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305627.608191:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305627.608202:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015252736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305627.608234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305627.608333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252608 00000100:00100000:2.0:1788305627.608342:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252608 00000100:00100000:2.0:1788305627.608391:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252736 00000100:00100000:2.0:1788305627.608395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252736 00000100:00100000:2.0:1788305627.608414:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788305627.608422:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015252608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305627.608456:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305627.608500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015252608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305627.608508:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788305627.608525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788305627.608531:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015252736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305627.608547:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788305627.608578:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890837a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015252736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305627.608584:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788305627.608844:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015252736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305627.609460:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bf93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015252608:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305627.767341:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305627.767397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305627.767430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305627.767467:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305627.767487:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305627.767506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305627.767623:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209280 00000100:00100000:0.0:1788305627.767633:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209280 00000100:00100000:0.0:1788305627.767706:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:0.0:1788305627.767718:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994209280:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305627.767792:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994209280:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305627.767800:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:1.0:1788305627.768398:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209024 00000100:00100000:1.0:1788305627.768404:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209024 00000100:00100000:1.0:1788305627.768461:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209536 00000100:00100000:1.0:1788305627.768464:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209536 00000100:00100000:1.0:1788305627.768480:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208896 00000100:00100000:1.0:1788305627.768483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208896 00000100:00100000:1.0:1788305627.768499:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 339 00000100:00100000:1.0:1788305627.768533:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994209024:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305627.768577:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994209024:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 46us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305627.768584:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 339 00000100:00100000:1.0:1788305627.768599:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 340 00000100:00100000:1.0:1788305627.768606:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994209536:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305627.768632:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994209536:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305627.768639:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 340 00000100:00100000:1.0:1788305627.768652:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 341 00000100:00100000:1.0:1788305627.768659:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2395:x1875173994208896:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305627.768685:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2395:x1875173994208896:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305627.768705:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 341 00000100:00080000:1.0:1788305627.768730:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305627.768735:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305627.768737:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305627.769132:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305627.770062:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209408 00000100:00100000:0.0:1788305627.770071:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209408 00000100:00100000:0.0:1788305627.770119:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 342 00000100:00100000:0.0:1788305627.770127:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2395:x1875173994209408:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305627.770204:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2395:x1875173994209408:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 77us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305627.770211:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 342 00000100:00100000:2.0:1788305627.775367:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994208768 00000100:00100000:2.0:1788305627.775385:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994208768 00000100:00100000:2.0:1788305627.775458:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 393 00000100:00100000:2.0:1788305627.775470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994208768:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305627.775566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994208768:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 98us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305627.775575:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 393 00000100:00100000:1.0:1788305627.775762:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209152 00000100:00100000:1.0:1788305627.775768:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209152 00000100:00100000:1.0:1788305627.775813:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:1.0:1788305627.775821:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994209152:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305627.775859:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994209152:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (8352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305627.775864:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00080000:1.0:1788305627.775886:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305627.775905:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305628.052008:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305628.062505:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209792 00000100:00100000:1.0:1788305628.062528:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209792 00000100:00100000:1.0:1788305628.062615:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:1.0:1788305628.062627:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:12156:x1875173994209792:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305628.062647:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305628.062670:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053ec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08598 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.062739:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.062753:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063052:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063072:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063079:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063084:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063193:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053edd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063202:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.063230:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053edd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305628.063241:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788305628.064034:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064045:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064052:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064058:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305628.064063:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064071:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064085:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88908337bd00) 00010000:00010000:1.0:1788305628.064088:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305628.064094:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064100:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6053ecf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064114:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064119:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064135:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064141:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305628.064144:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064150:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064158:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8891885c8200) 00010000:00010000:1.0:1788305628.064161:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305628.064164:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.064170:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6053ed6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.066595:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053ec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08598 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.066626:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053edd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08598 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305628.066636:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:1.0:1788305628.066639:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305628.066643:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50200, rc 0) 00000100:00100000:1.0:1788305628.066725:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:12156:x1875173994209792:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 4099us (14726us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788305628.066748:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:0.0:1788305628.070026:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305628.070126:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994209920 00000100:00100000:0.0:1788305628.070150:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305628.070237:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210048 00000100:00100000:1.0:1788305628.070248:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210048 00000100:00100000:1.0:1788305628.070355:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:1.0:1788305628.070367:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:12156:x1875173994210048:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788305628.070471:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:12156:x1875173994210048:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 107us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305628.070479:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:3.0:1788305628.070629:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994209920 00000100:00100000:3.0:1788305628.070950:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305628.070962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:2398:x1875173994209920:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305628.070980:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305628.071017:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053edd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08598 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305628.071046:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:3.0:1788305628.071052:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305628.073103:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:2398:x1875173994209920:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 2128us (3071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305628.073120:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788305628.084818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305628.086321:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210176 00000100:00100000:0.0:1788305628.086341:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210176 00000100:00100000:0.0:1788305628.086423:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:0.0:1788305628.086435:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:12156:x1875173994210176:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788305628.086568:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:12156:x1875173994210176:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 135us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305628.086576:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 152 00010000:00010000:3.0:1788305628.245549:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305628.310692:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305628.310707:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305628.310840:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788305628.310860:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788305628.822085:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305629.271489:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305630.294371:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305630.679308:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305630.679350:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015252864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305630.679434:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305630.681299:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252864 00000100:00100000:0.0:1788305630.681312:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252864 00000100:00100000:0.0:1788305630.681380:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788305630.681393:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015252864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305630.681427:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305630.681498:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015252864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305630.681505:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:1.0:1788305630.682636:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305630.682970:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015252992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305630.683027:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683055:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015253504:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683082:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683107:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015254016:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683130:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683146:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015254528:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683159:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683187:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015252864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305630.683204:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788305630.683207:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015253376:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683223:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683241:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015253888:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683255:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683264:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015254400:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683303:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683321:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015253120:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683342:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015253632:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683395:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015254144:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683435:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305630.683438:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015253248:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683475:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015253760:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683488:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015254272:0@lo:400:kworker.0 00000100:00100000:3.0:1788305630.683504:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305630.683521:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015252992 00000100:00100000:3.0:1788305630.683524:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015252992 00000100:00100000:3.0:1788305630.683555:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305630.683561:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015252992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305630.683574:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305630.683600:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015252992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305630.683605:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788305630.683625:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015252992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305630.686011:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253504 00000100:00100000:1.0:1788305630.686024:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253504 00000100:00100000:1.0:1788305630.686058:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253888 00000100:00100000:1.0:1788305630.686061:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253888 00000100:00100000:1.0:1788305630.686077:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254400 00000100:00100000:1.0:1788305630.686080:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254400 00000100:00100000:1.0:1788305630.686090:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253248 00000100:00100000:1.0:1788305630.686093:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253248 00000100:00100000:1.0:1788305630.686102:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253760 00000100:00100000:1.0:1788305630.686104:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253760 00000100:00100000:1.0:1788305630.686114:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254272 00000100:00100000:1.0:1788305630.686116:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254272 00000100:00100000:1.0:1788305630.686132:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788305630.686139:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015253504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686214:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015253504:12345-0@lo:400:kworker.0 Request processed in 76us (3132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686218:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788305630.686231:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788305630.686235:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015253888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686261:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015253888:12345-0@lo:400:kworker.0 Request processed in 27us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686266:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788305630.686287:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788305630.686291:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015254400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686308:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015254400:12345-0@lo:400:kworker.0 Request processed in 18us (3005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686311:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788305630.686318:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788305630.686321:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015253248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686346:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015253248:12345-0@lo:400:kworker.0 Request processed in 24us (2880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686351:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788305630.686362:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788305630.686367:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015253760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686393:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015253760:12345-0@lo:400:kworker.0 Request processed in 26us (2903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686398:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788305630.686408:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788305630.686412:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015254272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686430:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015254272:12345-0@lo:400:kworker.0 Request processed in 19us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686434:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788305630.686446:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254016 00000100:00100000:1.0:1788305630.686449:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254016 00000100:00100000:1.0:1788305630.686474:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254528 00000100:00100000:1.0:1788305630.686476:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254528 00000100:00100000:1.0:1788305630.686482:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254144 00000100:00100000:1.0:1788305630.686484:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254144 00000100:00100000:1.0:1788305630.686491:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305630.686494:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015254016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686515:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015254016:12345-0@lo:400:kworker.0 Request processed in 21us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686519:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305630.686525:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305630.686528:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015254528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686542:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015254528:12345-0@lo:400:kworker.0 Request processed in 15us (3383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686546:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305630.686550:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305630.686554:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015254144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686567:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015254144:12345-0@lo:400:kworker.0 Request processed in 13us (3153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686570:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305630.686580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253120 00000100:00100000:1.0:1788305630.686582:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253120 00000100:00100000:1.0:1788305630.686598:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788305630.686601:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015253120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686620:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015253120:12345-0@lo:400:kworker.0 Request processed in 19us (3278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686624:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788305630.686644:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253376 00000100:00100000:1.0:1788305630.686650:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253376 00000100:00100000:1.0:1788305630.686666:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015253632 00000100:00100000:1.0:1788305630.686667:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015253632 00000100:00100000:1.0:1788305630.686674:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788305630.686677:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015253376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686698:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015253376:12345-0@lo:400:kworker.0 Request processed in 21us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686702:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788305630.686708:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788305630.686712:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015253632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686726:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015253632:12345-0@lo:400:kworker.0 Request processed in 14us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.686729:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788305630.686762:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015253376:0@lo:400:kworker.0 00010000:00080000:1.0:1788305630.686772:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caaa300 x1875174015253888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305630.686779:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015253888:0@lo:400:kworker.0 00010000:00080000:1.0:1788305630.686786:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa9f80 x1875174015254400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305630.686791:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015254400:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686798:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015253504:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686804:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015254016:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686810:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015254528:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686837:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015253248:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686857:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015253760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686869:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015254272:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686877:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015253120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686886:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015253632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305630.686895:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015254144:0@lo:400:kworker.0 00000100:00080000:1.0:1788305630.686946:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305630.686952:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305630.686954:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305630.686955:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305630.687365:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305630.687378:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015254656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305630.687415:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305630.687440:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254656 00000100:00100000:1.0:1788305630.687443:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254656 00000100:00100000:1.0:1788305630.687462:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788305630.687467:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015254656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305630.687485:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788305630.687510:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015254656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305630.687514:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788305630.687536:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfa13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015254656:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305630.687872:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015254784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305630.687898:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305630.687970:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015254784 00000100:00100000:0.0:1788305630.687974:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015254784 00000100:00100000:0.0:1788305630.688008:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788305630.688022:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015254784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305630.688033:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788305630.688062:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfa13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015254784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305630.688068:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788305630.688098:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015254784:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788305630.692154:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:0.0:1788305630.846501:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305630.850526:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210304 00000100:00100000:2.0:1788305630.850542:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210304 00000100:00100000:2.0:1788305630.850626:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:2.0:1788305630.850636:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:12198:x1875173994210304:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305630.850657:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305630.850677:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0859f expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850740:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850755:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850766:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850780:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850786:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850793:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850837:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850844:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305630.850874:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788305630.850874:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850888:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305630.850894:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850913:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850927:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:2.0:1788305630.850930:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305630.850935:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850941:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850956:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850974:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850979:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.850984:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305630.850987:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.851002:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.851010:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff88908362e600) 00010000:00010000:2.0:1788305630.851012:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305630.851015:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.851020:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053ef9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.851051:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053eeb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0859f expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.853469:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:2.0:1788305630.853474:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305630.853485:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0859f expref: 14 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.853500:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305630.853587:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:12198:x1875173994210304:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 2951us (7091us total) trans 0 rc 301/301 00000100:00100000:2.0:1788305630.853597:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:2.0:1788305630.861330:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305630.861477:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210560 00000100:00100000:0.0:1788305630.861486:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210560 00000100:00100000:0.0:1788305630.861535:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:0.0:1788305630.861544:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:12198:x1875173994210560:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:0.0:1788305630.861594:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305630.861619:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e605383f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083c3 expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305630.861636:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:0.0:1788305630.861641:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305630.861698:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305630.861712:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305630.861721:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305630.861753:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 5 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305630.861777:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 5 pid: 6520 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305630.861792:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015254912:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305630.861877:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788305630.871110:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305630.872146:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015254912:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305630.872194:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305630.872926:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210688 00000100:00100000:2.0:1788305630.872941:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210688 00010000:00010000:2.0:1788305630.873016:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 6 pid: 6520 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305630.873075:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:2.0:1788305630.873086:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2395:x1875173994210688:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305630.873106:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305630.873115:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 6 pid: 6520 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873131:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 6 pid: 6520 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873158:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e6053ec1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08591 expref: 6 pid: 6520 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873174:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:2.0:1788305630.873181:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873192:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873200:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305630.873228:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305630.873323:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994210688:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 238us (2228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305630.873332:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00080000:2.0:1788305630.873361:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788305630.875449:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.875468:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.875504:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.875516:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.875527:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876138:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876147:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876153:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305630.876165:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001fc7a42 reply state 000000003070ac8d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876172:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876186:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305630.876188:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305630.876192:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788305630.876197:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788305630.876203:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876208:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876212:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876216:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305630.876219:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876224:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876232:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825bb800) 00010000:00010000:1.0:1788305630.876234:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305630.876236:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876241:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6053f00 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305630.876262:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001fc7a42 reply state 000000003070ac8d transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876303:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305630.876308:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8891885c8500) 00010000:00010000:1.0:1788305630.876311:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305630.876313:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788305630.876532:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:12198:x1875173994210560:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 14985us (15207us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788305630.876539:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:0.0:1788305631.032167:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305631.032326:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210816 00000100:00100000:3.0:1788305631.032349:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210816 00000100:00100000:3.0:1788305631.032407:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:3.0:1788305631.032418:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+14:12206:x1875173994210816:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:3.0:1788305631.032442:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305631.032466:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053f15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085a6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032531:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032561:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032575:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305631.032625:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305631.032629:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305631.032650:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032675:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053f15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085a6 expref: 16 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032692:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085a6 expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.032700:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:3.0:1788305631.032703:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305631.032706:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523b600, rc 0) 00000100:00100000:3.0:1788305631.032765:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:12206:x1875173994210816:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 349us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305631.032772:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:2.0:1788305631.125757:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.125851:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994210944 00000100:00100000:0.0:1788305631.125861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994210944 00000100:00100000:0.0:1788305631.125968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 156 00000100:00100000:0.0:1788305631.125978:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bf93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+15:12212:x1875173994210944:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305631.126000:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305631.126020:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085ad expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126084:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126098:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126108:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126120:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126127:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126161:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126236:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126244:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126251:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305631.126326:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788305631.126330:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305631.126352:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126364:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126370:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126376:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126383:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305631.126387:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126394:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126414:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:0.0:1788305631.126417:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305631.126421:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126427:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126442:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126447:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126452:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126457:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305631.126460:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126479:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8891885c8500) 00010000:00010000:0.0:1788305631.126490:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305631.126493:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126499:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126537:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6053f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085ad expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126550:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085ad expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.126556:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305631.126558:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788305631.126560:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8e00, rc 0) 00000100:00100000:0.0:1788305631.126624:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bf93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:12212:x1875173994210944:12345-192.168.202.55@tcp:101:bash.0 Request processed in 646us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305631.126631:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 156 00000100:00100000:0.0:1788305631.131601:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305631.131927:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994211200 00000100:00100000:3.0:1788305631.131938:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994211200 00000100:00100000:3.0:1788305631.131999:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 157 00000100:00100000:3.0:1788305631.132009:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+16:12212:x1875173994211200:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305631.132030:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305631.132063:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053f3f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085b4 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132165:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132179:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132191:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132206:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.132219:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305631.132932:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788305631.133081:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133091:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133100:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133133:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133154:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133159:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133165:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305631.133170:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133177:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133190:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305631.133193:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305631.133197:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133202:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e6053f46 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305631.133215:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d121c62 reply state 000000007a2fe0de transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133224:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133229:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:3.0:1788305631.133231:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305631.133234:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305631.133264:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6053f3f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 19 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133327:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 18 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.133336:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:3.0:1788305631.133338:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305631.133340:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305631.134109:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12212:x1875173994211200:12345-192.168.202.55@tcp:101:bash.0 Request processed in 2098us (2516us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788305631.134120:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 157 00000100:00100000:0.0:1788305631.138757:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.138875:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994211328 00000100:00100000:1.0:1788305631.138887:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994211328 00000100:00100000:1.0:1788305631.139014:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:1.0:1788305631.139026:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994211328:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305631.139044:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305631.139064:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085bb expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305631.139090:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305631.139109:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=461s v=(0 0) 00010000:00010000:1.0:1788305631.139113:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305631.139124:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.139143:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.139306:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50600, rc 0) 00000100:00100000:1.0:1788305631.139412:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb26ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994211328:12345-192.168.202.55@tcp:101:bash.0 Request processed in 389us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305631.139420:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00080000:2.0:1788305631.139655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305631.147880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.147983:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994211456 00000100:00100000:1.0:1788305631.147993:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994211456 00000100:00100000:1.0:1788305631.148054:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:1.0:1788305631.148065:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:12212:x1875173994211456:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305631.148081:0:8436:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305631.148097:0:8436:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085c2 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.148128:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.148138:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305631.148142:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305631.148165:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.148199:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.148213:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305631.148238:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875174015255040:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305631.148371:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305631.150852:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8436:1875174015255040:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305631.150885:0:8436:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 7 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.150916:0:8436:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50e00, rc 0) 00000100:00100000:1.0:1788305631.150974:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:12212:x1875173994211456:12345-192.168.202.55@tcp:101:bash.0 Request processed in 2912us (3103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305631.150983:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:3.0:1788305631.154037:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.154125:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994211584 00000100:00100000:0.0:1788305631.154134:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994211584 00010000:00010000:0.0:1788305631.154188:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305631.154233:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:0.0:1788305631.154244:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994211584:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305631.154262:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305631.154323:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.154359:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.154393:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6053f62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085bb expref: 7 pid: 8435 timeout: 561 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.154410:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305631.154414:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305631.154422:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.154431:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.154485:0:7471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305631.154500:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7471:1875174015255168:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788305631.154573:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305631.161858:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7471:1875174015255168:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305631.161885:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305631.161958:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994211584:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 7714us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305631.161969:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:2.0:1788305631.169550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.169660:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994211840 00000100:00100000:0.0:1788305631.169669:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994211840 00000100:00100000:0.0:1788305631.169728:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788305631.169739:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12212:x1875173994211840:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:0.0:1788305631.170049:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:12212:x1875173994211840:12345-192.168.202.55@tcp:35:bash.0 Request processed in 310us (505us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788305631.170057:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00010000:00010000:3.0:1788305631.317482:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305631.319031:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.319468:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994212096 00000100:00100000:0.0:1788305631.319479:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994212096 00000100:00100000:0.0:1788305631.319535:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 158 00000100:00100000:0.0:1788305631.319546:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:12222:x1875173994212096:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305631.319574:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305631.319598:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085c9 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305631.319707:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788305631.319806:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c9 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.319820:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:0.0:1788305631.319822:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305631.319827:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c9 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.319841:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8800, rc 0) 00000100:00100000:0.0:1788305631.319914:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12222:x1875173994212096:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 370us (892us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1788305631.319943:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 158 00000100:00100000:3.0:1788305631.326942:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.327489:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994212352 00000100:00100000:0.0:1788305631.327504:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994212352 00000100:00100000:0.0:1788305631.327582:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:0.0:1788305631.327592:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12222:x1875173994212352:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305631.327822:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:12222:x1875173994212352:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 230us (896us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788305631.327830:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:3.0:1788305631.465729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.465924:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994212480 00000100:00100000:2.0:1788305631.465938:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994212480 00000100:00100000:2.0:1788305631.466054:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:2.0:1788305631.466067:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:12229:x1875173994212480:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305631.466101:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305631.466128:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053f7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085d0 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466614:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466634:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466647:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305631.466843:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788305631.466847:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305631.466873:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466918:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d0 expref: 24 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466942:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d0 expref: 23 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.466975:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305631.466978:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305631.466983:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305631.467067:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:12229:x1875173994212480:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1003us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.467076:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 159 00000100:00100000:3.0:1788305631.472968:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.473095:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994212736 00000100:00100000:0.0:1788305631.473107:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994212736 00000100:00100000:0.0:1788305631.473191:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:0.0:1788305631.473204:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:12229:x1875173994212736:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305631.473232:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305631.473270:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085d7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.473860:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.473881:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.473924:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305631.473939:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788305631.474081:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053f8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d7 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.474124:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d7 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.474134:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:0.0:1788305631.474138:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305631.474142:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9800, rc 0) 00000100:00100000:0.0:1788305631.474221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12229:x1875173994212736:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1019us (1270us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788305631.474230:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 160 00000100:00100000:3.0:1788305631.483332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305631.483887:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994212864 00000100:00100000:0.0:1788305631.483911:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994212864 00000100:00100000:0.0:1788305631.484001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:0.0:1788305631.484014:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:2395:x1875173994212864:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305631.484042:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305631.484076:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053f93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d7 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.484101:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:0.0:1788305631.484107:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305631.484182:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:2395:x1875173994212864:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 170us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305631.484191:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788305631.487628:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.488007:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213120 00000100:00100000:1.0:1788305631.488029:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213120 00000100:00100000:1.0:1788305631.488110:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 161 00000100:00100000:1.0:1788305631.488122:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:12229:x1875173994213120:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305631.488164:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305631.488193:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fa1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085de expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.488644:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.488674:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.488691:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305631.488727:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788305631.489121:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fa1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085de expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.489571:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085de expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.489584:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:1.0:1788305631.489587:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788305631.489593:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50200, rc 0) 00000100:00100000:1.0:1788305631.489755:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12229:x1875173994213120:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1634us (2150us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788305631.489766:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 161 00000100:00100000:1.0:1788305631.506464:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305631.506692:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213248 00000100:00100000:3.0:1788305631.506706:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213248 00000100:00100000:3.0:1788305631.506782:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:3.0:1788305631.506794:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994213248:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:3.0:1788305631.506855:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.506881:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.506929:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305631.506935:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305631.506940:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.506986:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.507003:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 6 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305631.507021:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015255296:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305631.507645:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908272da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305631.532091:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015255296:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305631.532128:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305631.534415:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.534730:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213376 00000100:00100000:2.0:1788305631.534754:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213376 00002000:00100000:2.0:1788305631.534827:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff88918caa9880 x1875173994213376/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:562/0 lens 504/0 e 0 to 0 dl 1788305642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305631.534839:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88918caa9880 with x1875173994213376 ext(0->12) 00010000:00010000:2.0:1788305631.534850:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 7 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.534871:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 7 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305631.534880:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88918caa9880 00000100:00100000:2.0:1788305631.534941:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305631.534952:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994213376:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:2.0:1788305631.538188:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994213376:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 3225us (3776us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788305631.538206:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00002000:00100000:2.0:1788305631.538224:0:8443:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff88918caa9880 x1875173994213376/t4294967306(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:562/0 lens 504/448 e 0 to 0 dl 1788305642 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788305631.538253:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff88918caa9880 with x1875173994213376 ext(0->12) 00010000:00010000:2.0:1788305631.538264:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.538317:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305631.538326:0:8443:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88918caa9880 00000100:00100000:0.0:1788305631.549940:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.550160:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213504 00000100:00100000:2.0:1788305631.550174:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213504 00010000:00010000:2.0:1788305631.550229:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305631.550524:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:2.0:1788305631.550538:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994213504:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305631.550561:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788305631.550588:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788305631.550591:0:10341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788305630 00002000:00010000:2.0:1788305631.550593:0:10341:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788305631 00002000:00010000:2.0:1788305631.550595:0:10341:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788305630 00002000:00010000:2.0:1788305631.550597:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788305631.550604:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.550620:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.550681:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c30513ac/0x4a426866e6053f69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085c2 expref: 9 pid: 8436 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.550701:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305631.550706:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305631.550712:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.550724:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.551993:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305631.552098:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994213504:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1557us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.552109:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00010000:00010000:3.0:1788305631.552255:0:8437:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552303:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552337:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552366:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552376:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552383:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305631.552388:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552397:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552418:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305631.552426:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043668e6c/0x4a426866e6053fb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305631.552528:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994213248:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 45732us (46077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305631.552538:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:0.0:1788305631.562854:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.563045:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213760 00000100:00100000:1.0:1788305631.563061:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213760 00000100:00100000:1.0:1788305631.563139:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:1.0:1788305631.563163:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12229:x1875173994213760:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:1.0:1788305631.563267:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085de expref: 26 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305631.563573:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788305631.563610:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788305631.564037:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788305631.564084:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.564120:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.564132:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.564180:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 30 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.564201:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 30 pid: 6521 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305631.564220:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015255424:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305631.564381:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb04d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305631.574019:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caab800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015255424:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305631.574063:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305631.577890:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.578336:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994213888 00000100:00100000:1.0:1788305631.578351:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994213888 00010000:00010000:1.0:1788305631.578408:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 31 pid: 6521 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305631.578450:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:1.0:1788305631.578462:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+31:2395:x1875173994213888:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305631.578485:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305631.578503:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 31 pid: 6521 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578519:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 31 pid: 6521 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578547:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6053f54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085b4 expref: 31 pid: 6521 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578567:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:1.0:1788305631.578573:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578585:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578593:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.578633:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305631.578716:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:2395:x1875173994213888:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 255us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305631.578725:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00010000:00010000:2.0:1788305631.578972:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.578982:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305631.579139:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:2.0:1788305631.579338:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1788305631.579462:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015255552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305631.579539:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305631.579582:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890837689c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305631.579612:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015255552 00000100:00100000:2.0:1788305631.579629:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015255552 00000100:00100000:2.0:1788305631.579688:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788305631.579698:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918346d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875174015255552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305631.579811:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918346d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6523:x1875174015255552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 115us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.579817:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788305631.580189:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015255552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788305631.580372:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788305631.580427:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015255680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305631.580461:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305631.580491:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015255680 00000100:00100000:2.0:1788305631.580495:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015255680 00000100:00100000:2.0:1788305631.580525:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788305631.580533:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1875174015255680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305631.580640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1875174015255680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (177us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788305631.580647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788305631.580668:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305631.580688:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015255680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788305631.580725:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788305631.580761:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580770:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580777:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580795:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305631.580800:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580809:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580826:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:2.0:1788305631.580830:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788305631.580836:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.580842:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6053fbd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788305631.580967:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788305631.581050:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788305631.581063:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 461671786867ns, next at 462671783998ns, rc = 0 00000001:00080000:2.0:1788305631.581071:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788305631.581117:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7900) 00010000:00010000:2.0:1788305631.581121:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788305631.581128:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6053fa8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085de expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305631.581227:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:12229:x1875173994213760:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 18068us (18389us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788305631.581236:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000020:00080000:2.0:1788305631.581241:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788305631.595512:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.595762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994214016 00000100:00100000:2.0:1788305631.595778:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994214016 00000100:00100000:2.0:1788305631.595848:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:2.0:1788305631.595860:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+33:12229:x1875173994214016:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305631.595905:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305631.595934:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053fc4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085e5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.596028:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085e5 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.596046:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053fc4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085e5 expref: 34 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.596067:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305631.596071:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305631.596077:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea800, rc 0) 00000100:00100000:2.0:1788305631.596159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:12229:x1875173994214016:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 302us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.596167:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 162 00000100:00100000:3.0:1788305631.605068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.606381:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994214272 00000100:00100000:2.0:1788305631.606399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994214272 00000100:00100000:2.0:1788305631.606479:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:2.0:1788305631.606492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:12229:x1875173994214272:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305631.608062:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:12229:x1875173994214272:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 675us (2112us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788305631.608080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:3.0:1788305631.754378:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.754704:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994214528 00000100:00100000:1.0:1788305631.754716:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994214528 00000100:00100000:1.0:1788305631.754783:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00100000:1.0:1788305631.754794:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:12239:x1875173994214528:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305631.754823:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305631.754843:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053fcb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085ec expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305631.754979:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788305631.755085:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053fcb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085ec expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.755100:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:1.0:1788305631.755103:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788305631.755108:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6053fcb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085ec expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305631.755123:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305631.755194:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:12239:x1875173994214528:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 401us (826us total) trans 4294967435 rc 301/301 00000100:00100000:1.0:1788305631.755202:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 163 00000100:00100000:0.0:1788305631.771472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.771590:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994214656 00000100:00100000:2.0:1788305631.771599:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994214656 00000100:00100000:2.0:1788305631.771670:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:2.0:1788305631.771681:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:12239:x1875173994214656:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788305631.771756:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771773:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771783:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771796:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771805:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771811:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771886:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771905:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.771913:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305631.771973:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772001:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772007:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772015:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772020:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305631.772026:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772034:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772046:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305631.772049:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305631.772053:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772059:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6053fd9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772072:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772079:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772085:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772097:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305631.772100:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772106:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772115:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:2.0:1788305631.772118:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305631.772120:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772127:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6053fe0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772137:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772143:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772161:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772166:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305631.772168:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772173:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772189:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305631.772191:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305631.772194:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.772199:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6053fe7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305631.772340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:12239:x1875173994214656:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 660us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.772348:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 164 00000100:00100000:0.0:1788305631.779356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.779443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994214912 00000100:00100000:2.0:1788305631.779454:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994214912 00000100:00100000:2.0:1788305631.779515:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788305631.779525:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+36:12239:x1875173994214912:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305631.779751:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12239:x1875173994214912:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 226us (406us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788305631.779758:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:3.0:1788305631.859079:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305631.859890:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994215168 00000100:00100000:1.0:1788305631.859913:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994215168 00000100:00100000:0.0:1788305631.860786:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00100000:0.0:1788305631.860800:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12242:x1875173994215168:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305631.860826:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305631.860847:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053fee lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085f3 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.860940:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861072:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861085:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861098:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861106:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861113:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861710:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861722:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861748:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305631.861759:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788305631.861844:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861852:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861859:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861865:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305631.861869:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861876:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861888:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305631.861901:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305631.861906:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861912:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6053ff5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861926:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861931:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.861944:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862029:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305631.862033:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862039:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862049:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:0.0:1788305631.862051:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305631.862054:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862060:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6053ffc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862102:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6053fee lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862115:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305631.862122:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305631.862255:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305631.862259:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8000, rc 0) 00000100:00100000:0.0:1788305631.862508:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12242:x1875173994215168:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1710us (3438us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788305631.862528:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 165 00000100:00100000:1.0:1788305631.867878:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.867973:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994215296 00000100:00100000:2.0:1788305631.867983:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994215296 00000100:00100000:2.0:1788305631.868040:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 166 00000100:00100000:2.0:1788305631.868050:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12242:x1875173994215296:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:2.0:1788305631.868122:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868180:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868216:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868222:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868228:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868233:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305631.868237:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868244:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868255:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305631.868259:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305631.868263:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305631.868268:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054011 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305631.868377:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12242:x1875173994215296:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 319us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305631.868386:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 166 00000100:00100000:3.0:1788305631.871386:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305631.871477:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994215552 00000100:00100000:2.0:1788305631.871501:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994215552 00000100:00100000:2.0:1788305631.871562:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:2.0:1788305631.871571:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12242:x1875173994215552:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305631.871861:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+40:12242:x1875173994215552:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 290us (499us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788305631.871869:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788305632.331404:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305632.342206:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994215808 00000100:00100000:2.0:1788305632.342222:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994215808 00000100:00100000:2.0:1788305632.342328:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00100000:2.0:1788305632.342353:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+40:12273:x1875173994215808:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788305632.342382:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305632.342403:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054018 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe085fa expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.342518:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605401f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.342532:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605401f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.342545:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605401f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305632.342556:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788305632.342660:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054018 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085fa expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.342681:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605401f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085fa expref: 42 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.342711:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305632.342715:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305632.342718:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea400, rc 0) 00000100:00100000:2.0:1788305632.342786:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12273:x1875173994215808:12345-192.168.202.55@tcp:101:cat.0 Request processed in 439us (11393us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788305632.342794:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 167 00000100:00080000:3.0:1788305632.343133:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788305632.343369:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305632.361189:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305632.361245:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305632.361390:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994216192 00000100:00100000:2.0:1788305632.361401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994216192 00000100:00100000:2.0:1788305632.361471:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:2.0:1788305632.361482:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12273:x1875173994216192:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:2.0:1788305632.361754:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:12273:x1875173994216192:12345-192.168.202.55@tcp:35:cat.0 Request processed in 272us (506us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788305632.361762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:3.0:1788305632.362327:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994215936 00000100:00100000:3.0:1788305632.362341:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994215936 00000100:00100000:3.0:1788305632.362426:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788305632.362437:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:2396:x1875173994215936:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305632.362454:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305632.362484:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e605401f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085fa expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.362507:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305632.362513:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305632.362577:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:2396:x1875173994215936:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 142us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305632.362593:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305632.493739:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305632.493876:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994216448 00000100:00100000:2.0:1788305632.493905:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994216448 00000100:00100000:2.0:1788305632.494005:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 168 00000100:00100000:2.0:1788305632.494018:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12279:x1875173994216448:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:2.0:1788305632.494056:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305632.494060:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788305632.494096:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6053f85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085d0 expref: 42 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.494122:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305632.494128:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305632.496580:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605402d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08601 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.496760:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.496783:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.496795:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.496848:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.496869:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 42 pid: 6521 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305632.496896:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015255808:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305632.497028:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305632.503482:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305632.503637:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994216576 00000100:00100000:3.0:1788305632.503646:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994216576 00010000:00010000:3.0:1788305632.503699:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 43 pid: 6521 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305632.503749:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:3.0:1788305632.503759:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:2395:x1875173994216576:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305632.503775:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305632.503781:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 43 pid: 6521 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.503815:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 43 pid: 6521 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.503839:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305632.503844:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.503854:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.503862:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.503880:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305632.504123:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054003 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085f3 expref: 43 pid: 6521 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305632.504142:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015255808:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305632.504162:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.504171:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.504188:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305632.504207:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788305632.504382:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605402d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.504397:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.504405:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305632.504407:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305632.504410:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:3.0:1788305632.504499:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:2395:x1875173994216576:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 740us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305632.504508:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:2.0:1788305632.510662:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12279:x1875173994216448:12345-192.168.202.55@tcp:101:dd.0 Request processed in 16623us (16918us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788305632.510676:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 168 00000100:00100000:1.0:1788305632.539845:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305632.539972:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994216704 00000100:00100000:2.0:1788305632.539982:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994216704 00000100:00100000:2.0:1788305632.540044:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:2.0:1788305632.540054:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12279:x1875173994216704:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:2.0:1788305632.540078:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305632.540098:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054042 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08608 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540135:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540183:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540195:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540349:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054042 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 44 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540368:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 43 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.540377:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305632.540380:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305632.540384:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb000, rc 0) 00000100:00100000:2.0:1788305632.540440:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:12279:x1875173994216704:12345-192.168.202.55@tcp:101:dd.0 Request processed in 387us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305632.540447:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:0.0:1788305632.545701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305632.545842:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994216960 00000100:00100000:2.0:1788305632.545853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994216960 00000100:00100000:2.0:1788305632.545922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 170 00000100:00100000:2.0:1788305632.545932:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:12279:x1875173994216960:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:2.0:1788305632.546181:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.546199:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.546226:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305632.546269:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788305632.546340:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e18f76ee reply state 00000000b9939d66 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.546353:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305632.546360:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305632.546363:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788305632.546367:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305632.546459:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:12279:x1875173994216960:12345-192.168.202.55@tcp:36:dd.0 Request processed in 528us (767us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788305632.546466:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 170 00000020:00080000:2.0:1788305632.546484:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788305632.725568:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015256064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305632.725648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305632.725771:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305632.725777:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015255936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305632.725804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305632.725918:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015256064 00000100:00100000:2.0:1788305632.725927:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015256064 00000100:00100000:2.0:1788305632.725981:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015255936 00000100:00100000:2.0:1788305632.725985:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015255936 00000100:00100000:2.0:1788305632.726007:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305632.726015:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015256064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305632.726050:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305632.726097:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015256064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305632.726104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788305632.726123:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788305632.726129:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015255936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305632.726163:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788305632.726193:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015255936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305632.726199:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788305632.726331:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015255936:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305632.726347:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015256064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305632.878929:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.878977:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.879014:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.879032:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.879053:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.879074:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305632.879100:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217344 00000100:00100000:0.0:1788305632.879108:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217344 00000100:00100000:0.0:1788305632.879168:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217472 00000100:00100000:0.0:1788305632.879171:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217472 00000100:00100000:0.0:1788305632.879190:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:0.0:1788305632.879199:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994217344:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305632.879264:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2396:x1875173994217344:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 66us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305632.879323:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:0.0:1788305632.879340:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:0.0:1788305632.879347:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994217472:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305632.879374:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994217472:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305632.879380:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:0.0:1788305632.879626:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217600 00000100:00100000:0.0:1788305632.879630:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217600 00000100:00100000:0.0:1788305632.879657:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217216 00000100:00100000:0.0:1788305632.879660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217216 00000100:00100000:0.0:1788305632.879673:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217728 00000100:00100000:0.0:1788305632.879675:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217728 00000100:00100000:0.0:1788305632.879689:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 349 00000100:00100000:0.0:1788305632.879695:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994217600:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305632.880301:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994217600:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 601us (1282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305632.880311:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 349 00000100:00100000:0.0:1788305632.880329:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 350 00000100:00100000:0.0:1788305632.880338:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994217216:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305632.880372:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994217216:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 37us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305632.880378:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 350 00000100:00100000:0.0:1788305632.880390:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 351 00000100:00100000:0.0:1788305632.880396:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994217728:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305632.880435:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994217728:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 39us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305632.880441:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 351 00000100:00100000:3.0:1788305632.881335:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217088 00000100:00100000:3.0:1788305632.881344:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217088 00000100:00100000:3.0:1788305632.881393:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 395 00000100:00100000:3.0:1788305632.881402:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994217088:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305632.881451:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994217088:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 50us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305632.881457:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 395 00000100:00080000:3.0:1788305632.881502:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305632.881507:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305632.881511:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305632.938460:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305632.938674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994217856 00000100:00100000:1.0:1788305632.938683:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994217856 00000100:00100000:1.0:1788305632.938758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:1.0:1788305632.938770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:12293:x1875173994217856:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:1.0:1788305632.938797:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305632.938820:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6054057 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0860f expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938916:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938931:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938944:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938957:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938964:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.938970:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.939042:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.939053:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.939061:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.939095:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.939118:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 47 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305632.939134:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015256192:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305632.939260:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb04d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305632.943127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305632.944076:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015256192:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305632.944113:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305632.945030:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994218112 00000100:00100000:2.0:1788305632.945045:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994218112 00000100:00100000:2.0:1788305632.945266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:2.0:1788305632.945296:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:6169:x1875173994218112:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788305632.946313:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:6169:x1875173994218112:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 464us (2628us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788305632.946326:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:1.0:1788305632.948903:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305632.949194:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994218240 00000100:00100000:3.0:1788305632.949207:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994218240 00010000:00010000:3.0:1788305632.949261:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 49 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305632.949342:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 85 00000100:00100000:3.0:1788305632.949354:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:2395:x1875173994218240:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305632.950043:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305632.950056:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 49 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950075:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 49 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950106:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054034 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08601 expref: 49 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950129:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305632.950135:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950161:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950171:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305632.950211:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305632.950355:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:2395:x1875173994218240:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1002us (1476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305632.950468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 85 00010000:00010000:1.0:1788305632.951031:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951043:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305632.951125:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788305632.951131:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305632.951173:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951192:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951203:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951210:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951230:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951237:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305632.951242:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951250:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951264:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305632.951267:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305632.951271:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951307:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e605405e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951323:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951329:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951334:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951339:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305632.951342:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951358:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951379:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:1.0:1788305632.951381:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305632.951385:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951391:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054065 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951433:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e6054057 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0860f expref: 48 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951450:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0860f expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305632.951458:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305632.951460:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305632.951462:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51200, rc 0) 00000100:00100000:1.0:1788305632.951510:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:12293:x1875173994217856:12345-192.168.202.55@tcp:101:stat.0 Request processed in 12743us (13060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305632.951517:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:3.0:1788305633.029218:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305633.029587:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994218496 00000100:00100000:2.0:1788305633.029602:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994218496 00000100:00100000:2.0:1788305633.029696:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 172 00000100:00100000:2.0:1788305633.029709:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:12299:x1875173994218496:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:2.0:1788305633.029800:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305633.029843:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605406c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0860f expref: 47 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.029869:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305633.029875:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305633.030121:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.030140:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.030177:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305633.030232:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788305633.030258:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d51e00c reply state 000000007e64075f transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.030272:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.030335:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305633.030338:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788305633.030341:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305633.030477:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:12299:x1875173994218496:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 770us (1275us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788305633.030487:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 172 00000020:00080000:2.0:1788305633.030494:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305633.216745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.217024:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994218624 00000100:00100000:0.0:1788305633.217039:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994218624 00000100:00100000:0.0:1788305633.217124:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:0.0:1788305633.217137:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+49:12313:x1875173994218624:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:0.0:1788305633.217175:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305633.217206:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605407a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08616 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217358:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217377:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217392:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217405:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217413:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217420:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217543:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217553:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217560:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305633.217617:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788305633.217623:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305633.217650:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217665:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217674:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217680:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217687:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217695:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305633.217700:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217709:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.217731:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305633.217734:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305633.218075:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218085:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054081 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218105:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218112:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218118:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218123:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305633.218126:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218133:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218142:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:0.0:1788305633.218144:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305633.218148:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218154:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054088 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218210:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e605407a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 51 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218225:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 50 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.218233:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305633.218235:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305633.218238:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8400, rc 0) 00000100:00100000:0.0:1788305633.218542:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:12313:x1875173994218624:12345-192.168.202.55@tcp:101:stat.0 Request processed in 1406us (1822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305633.218552:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 173 00000100:00100000:3.0:1788305633.321536:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305633.321733:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994218880 00000100:00100000:2.0:1788305633.321752:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994218880 00000100:00100000:2.0:1788305633.321939:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:2.0:1788305633.321953:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+50:12323:x1875173994218880:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305633.321983:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305633.322013:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0861d expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305633.322177:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788305633.322375:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054096 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0861d expref: 52 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.322424:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:2.0:1788305633.322428:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788305633.322434:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e6054096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0861d expref: 52 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305633.322453:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb600, rc 0) 00000100:00100000:2.0:1788305633.322547:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:12323:x1875173994218880:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 597us (1021us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1788305633.322556:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 174 00000100:00100000:3.0:1788305633.325496:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305633.325639:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994219136 00000100:00100000:1.0:1788305633.325657:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994219136 00000100:00100000:1.0:1788305633.325742:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:1.0:1788305633.325756:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+51:12323:x1875173994219136:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788305633.326102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:12323:x1875173994219136:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 348us (616us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788305633.326112:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00010000:00010000:3.0:1788305633.366434:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305633.401332:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305633.401800:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994219392 00000100:00100000:1.0:1788305633.401810:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994219392 00000100:00100000:1.0:1788305633.401874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 175 00000100:00100000:1.0:1788305633.401894:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:12329:x1875173994219392:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305633.401917:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305633.401937:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e60540a4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08624 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.402059:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.402073:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.402082:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.402115:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 53 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.402129:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 53 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305633.402141:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015256320:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305633.402246:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305633.404904:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015256320:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305633.404934:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305633.407508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305633.409054:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994219520 00000100:00100000:1.0:1788305633.409067:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994219520 00010000:00010000:1.0:1788305633.409120:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 54 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305633.409172:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 86 00000100:00100000:1.0:1788305633.409182:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:2396:x1875173994219520:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305633.409196:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305633.409203:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 54 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409215:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 54 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409238:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e605408f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08616 expref: 54 pid: 6520 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409256:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305633.409261:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409271:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409360:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.409391:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305633.409456:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:2396:x1875173994219520:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 274us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305633.409464:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 86 00010000:00010000:0.0:1788305633.409629:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.409639:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305633.409664:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788305633.409812:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e60540a4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 54 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.409830:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 53 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.409838:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305633.409840:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788305633.409849:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50200, rc 0) 00000100:00100000:0.0:1788305633.409898:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:12329:x1875173994219392:12345-192.168.202.55@tcp:101:bash.0 Request processed in 8007us (8576us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788305633.409905:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 175 00000100:00100000:3.0:1788305633.421608:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.423055:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994219776 00000100:00100000:0.0:1788305633.423066:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994219776 00000100:00100000:0.0:1788305633.423125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 176 00000100:00100000:0.0:1788305633.423132:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+53:12329:x1875173994219776:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:0.0:1788305633.423359:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.423377:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.423387:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305633.423427:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788305633.423450:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060568d0a reply state 00000000282b8a0d transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.423462:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.423469:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305633.423471:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788305633.423475:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788305633.423565:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12329:x1875173994219776:12345-192.168.202.55@tcp:36:bash.0 Request processed in 432us (1967us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788305633.423572:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 176 00000020:00080000:0.0:1788305633.423591:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788305633.435654:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.435757:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994219904 00000100:00100000:0.0:1788305633.435767:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994219904 00000100:00100000:0.0:1788305633.435830:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 177 00000100:00100000:0.0:1788305633.435841:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12329:x1875173994219904:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305633.435865:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305633.435897:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60540c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0862b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.436007:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.436022:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.436031:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.436065:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 57 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.436078:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 57 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305633.436092:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015256448:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305633.436184:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305633.441272:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015256448:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305633.441331:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305633.442362:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.443105:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994220032 00000100:00100000:0.0:1788305633.443115:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994220032 00010000:00010000:0.0:1788305633.443166:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305633.443211:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 87 00000100:00100000:0.0:1788305633.443222:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:2395:x1875173994220032:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305633.443237:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305633.443244:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.443258:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.443412:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e60540ab lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08624 expref: 58 pid: 6521 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.443432:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305633.443437:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.443449:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.443564:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.444130:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305633.444231:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:2395:x1875173994220032:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1009us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305633.444240:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 87 00010000:00010000:3.0:1788305633.448133:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.448151:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305633.448211:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788305633.448217:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305633.448238:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.448355:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60540c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0862b expref: 57 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.448378:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0862b expref: 56 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.448388:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305633.448392:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305633.448413:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8600, rc 0) 00000100:00100000:3.0:1788305633.449175:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12329:x1875173994219904:12345-192.168.202.55@tcp:101:bash.0 Request processed in 13331us (13526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305633.449186:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 177 00000100:00100000:1.0:1788305633.461139:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305633.461832:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994220288 00000100:00100000:3.0:1788305633.461844:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994220288 00000100:00100000:3.0:1788305633.461918:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:3.0:1788305633.461929:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12329:x1875173994220288:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788305633.462140:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:12329:x1875173994220288:12345-192.168.202.55@tcp:35:bash.0 Request processed in 213us (1012us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788305633.462148:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305633.612471:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.612599:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994220544 00000100:00100000:0.0:1788305633.612608:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994220544 00000100:00100000:0.0:1788305633.612684:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:0.0:1788305633.612695:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+57:12339:x1875173994220544:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305633.612730:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305633.612751:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08632 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305633.612850:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788305633.612981:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08632 expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.612996:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:0.0:1788305633.613000:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305633.613005:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08632 expref: 59 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.613019:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8200, rc 0) 00000100:00100000:0.0:1788305633.613098:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12339:x1875173994220544:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 405us (637us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788305633.613106:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 178 00000100:00100000:0.0:1788305633.628444:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305633.628554:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994220672 00000100:00100000:1.0:1788305633.628565:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994220672 00000100:00100000:1.0:1788305633.628626:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 179 00000100:00100000:1.0:1788305633.628638:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12339:x1875173994220672:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:1.0:1788305633.628723:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628741:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628754:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628771:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628778:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628784:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628867:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628886:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.628902:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305633.629138:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629151:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629157:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629164:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629170:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305633.629175:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629183:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629196:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305633.629199:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305633.629202:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629214:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60540dc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629228:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629234:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629239:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629244:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305633.629247:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629252:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629259:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:1.0:1788305633.629261:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305633.629264:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629270:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60540e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629446:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629452:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629463:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629469:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305633.629472:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629477:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629486:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305633.629488:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305633.629491:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.629497:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60540ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305633.629598:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12339:x1875173994220672:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 962us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305633.629607:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 179 00000100:00100000:1.0:1788305633.633413:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305633.633537:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994220928 00000100:00100000:3.0:1788305633.633547:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994220928 00000100:00100000:3.0:1788305633.633604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788305633.633615:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12339:x1875173994220928:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305633.633849:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:12339:x1875173994220928:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 234us (443us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788305633.633857:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:3.0:1788305633.729259:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305633.735158:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994221184 00000100:00100000:0.0:1788305633.735174:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994221184 00000100:00100000:0.0:1788305633.735252:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:0.0:1788305633.735305:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:12342:x1875173994221184:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305633.735331:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305633.735353:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60540f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08639 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735429:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735443:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735455:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735466:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735472:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735478:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735600:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054106 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735609:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735617:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054106 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305633.735637:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788305633.735709:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735717:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735723:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735729:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305633.735733:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735740:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735752:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305633.735755:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305633.735758:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735764:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e60540f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735776:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735781:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735796:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735801:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305633.735804:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735810:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735818:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:0.0:1788305633.735820:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305633.735823:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735828:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8200/0x4a426866e60540ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735865:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60540f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08639 expref: 62 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735913:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054106 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08639 expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305633.735921:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305633.735923:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305633.735925:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9600, rc 0) 00000100:00100000:0.0:1788305633.736206:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:12342:x1875173994221184:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 930us (6956us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788305633.736222:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 180 00000100:00100000:0.0:1788305633.744101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305633.744183:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994221312 00000100:00100000:1.0:1788305633.744192:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994221312 00000100:00100000:1.0:1788305633.744260:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305633.744270:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:2397:x1875173994221312:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305633.744318:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305633.744344:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054106 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08639 expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305633.744391:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305633.744396:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305633.744453:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:2397:x1875173994221312:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 184us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305633.744460:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:1.0:1788305633.750053:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305633.750170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994221440 00000100:00100000:3.0:1788305633.750181:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994221440 00000100:00100000:3.0:1788305633.750239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:3.0:1788305633.750249:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12342:x1875173994221440:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788305633.750347:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750364:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750389:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750427:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750434:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750440:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750446:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305633.750451:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750458:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750469:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305633.750472:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305633.750477:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305633.750483:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054114 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305633.750550:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12342:x1875173994221440:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 302us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305633.750558:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 181 00000100:00100000:3.0:1788305633.754216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305633.754310:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994221696 00000100:00100000:3.0:1788305633.754325:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994221696 00000100:00100000:3.0:1788305633.754394:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:3.0:1788305633.754405:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12342:x1875173994221696:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305633.754672:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:12342:x1875173994221696:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 268us (467us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788305633.754681:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:0.0:1788305634.076095:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.076234:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994221952 00000100:00100000:2.0:1788305634.076244:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994221952 00000100:00080000:3.0:1788305634.076334:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305634.076373:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:2.0:1788305634.076385:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:12360:x1875173994221952:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:2.0:1788305634.076407:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305634.076431:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605411b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08640 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.077254:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054122 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.077272:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054122 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.077308:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054122 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305634.077334:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788305634.077786:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb600/0x4a426866e605411b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08640 expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.077809:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054122 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08640 expref: 63 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.077818:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:2.0:1788305634.077821:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788305634.077824:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21e00, rc 0) 00000100:00100000:2.0:1788305634.078559:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12360:x1875173994221952:12345-192.168.202.55@tcp:101:cat.0 Request processed in 2169us (2468us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788305634.078648:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 182 00000100:00100000:1.0:1788305634.120765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.120886:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222080 00000100:00100000:3.0:1788305634.120903:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222080 00000100:00100000:3.0:1788305634.120990:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:3.0:1788305634.121004:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12361:x1875173994222080:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305634.121037:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305634.121065:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08647 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121160:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121178:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121193:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305634.121247:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788305634.121251:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305634.121303:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121492:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08647 expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121517:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08647 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.121527:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305634.121530:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305634.121534:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305634.121748:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12361:x1875173994222080:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 746us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.121757:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 183 00000100:00100000:0.0:1788305634.132942:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.133224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222464 00000100:00100000:2.0:1788305634.133237:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222464 00000100:00100000:2.0:1788305634.133513:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788305634.133527:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12361:x1875173994222464:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305634.134116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12361:x1875173994222464:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 588us (1192us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788305634.134126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:0.0:1788305634.137116:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.137312:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222592 00000100:00100000:3.0:1788305634.137326:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222592 00000100:00100000:3.0:1788305634.137585:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:3.0:1788305634.137599:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12361:x1875173994222592:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:3.0:1788305634.137621:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788305634.137822:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60540c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0862b expref: 65 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.137854:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054122 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08640 expref: 64 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.137867:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6053fc4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085e5 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.137917:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.137924:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305634.138049:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12361:x1875173994222592:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 453us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.138058:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:1.0:1788305634.143021:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.143126:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222720 00000100:00100000:0.0:1788305634.143139:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222720 00000100:00100000:0.0:1788305634.143354:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:0.0:1788305634.143369:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12361:x1875173994222720:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:1.0:1788305634.143747:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.143770:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.143784:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305634.143925:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788305634.144026:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12361:x1875173994222720:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 659us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.144036:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 184 00000100:00100000:0.0:1788305634.174906:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.175003:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222848 00000100:00100000:3.0:1788305634.175016:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222848 00000100:00100000:3.0:1788305634.175138:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 185 00000100:00100000:3.0:1788305634.175164:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12363:x1875173994222848:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305634.175193:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305634.175219:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054145 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0864e expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175356:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175387:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175398:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175405:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175438:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175527:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175538:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305634.175597:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788305634.175602:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305634.175625:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175701:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175712:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175719:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175726:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175732:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.175737:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175753:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175769:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305634.175772:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305634.175777:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175783:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e605414c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175801:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175807:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175814:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175819:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.175822:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175828:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175835:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:3.0:1788305634.175838:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305634.175841:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175856:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054153 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175899:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054145 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175913:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.175921:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.175924:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305634.175927:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305634.176118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12363:x1875173994222848:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 957us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.176127:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 185 00010000:00010000:3.0:1788305634.390880:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305634.454957:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305634.454972:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305634.455024:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788305634.455037:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305634.455248:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015256576:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305634.459325:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305634.465259:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015256576:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305634.479025:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.479739:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994222976 00000100:00100000:2.0:1788305634.479752:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994222976 00000100:00100000:2.0:1788305634.479818:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 186 00000100:00100000:2.0:1788305634.479830:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12374:x1875173994222976:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305634.479859:0:10615:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305634.480504:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12374:x1875173994222976:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 673us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.480513:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 186 00000100:00100000:3.0:1788305634.499814:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.500095:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994223104 00000100:00100000:1.0:1788305634.500106:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994223104 00000100:00100000:1.0:1788305634.500171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:1.0:1788305634.500183:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12374:x1875173994223104:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788305634.500260:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500324:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500384:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500393:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500400:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500427:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500436:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500443:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305634.500487:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788305634.500492:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305634.500505:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500517:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500533:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500539:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500545:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.500549:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500556:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500568:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:1.0:1788305634.500571:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.500576:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500581:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054161 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500593:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500601:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500608:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500613:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.500621:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500627:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500634:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8891885c8a00) 00010000:00010000:1.0:1788305634.500637:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.500639:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500644:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054168 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500659:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500665:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500671:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500676:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.500678:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500684:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500690:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305634.500692:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.500700:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.500706:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e605416f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.500787:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12374:x1875173994223104:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 606us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.500795:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 187 00000100:00100000:1.0:1788305634.508862:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.509004:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994223360 00000100:00100000:3.0:1788305634.509015:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994223360 00000100:00100000:3.0:1788305634.509082:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:3.0:1788305634.509093:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12374:x1875173994223360:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.509116:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305634.509139:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054176 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08655 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509311:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509328:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509340:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305634.509362:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788305634.509443:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509451:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509458:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509464:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.509468:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509475:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.509490:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305634.509495:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509511:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605417d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509553:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054176 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08655 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509564:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:3.0:1788305634.509566:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305634.509570:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054176 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08655 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.509579:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519400, rc 0) 00000100:00100000:3.0:1788305634.509790:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994223360:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 698us (949us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788305634.509798:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 188 00000100:00100000:2.0:1788305634.512180:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.512260:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994223488 00000100:00100000:1.0:1788305634.512272:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994223488 00000100:00100000:1.0:1788305634.512364:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:1.0:1788305634.512376:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994223488:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788305634.512416:0:6521:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788305634.512543:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994223488:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 168us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.512551:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 189 00000100:00100000:3.0:1788305634.518523:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.518791:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994223744 00000100:00100000:0.0:1788305634.518802:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994223744 00000100:00100000:0.0:1788305634.518879:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:0.0:1788305634.518899:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994223744:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305634.518923:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305634.518926:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788305634.518957:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054137 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08647 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.518996:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305634.519002:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305634.519017:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e605418b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0865c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305634.519420:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788305634.519553:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054192 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.519566:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.519576:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054192 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.519626:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e605418b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0865c expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.519657:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054192 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0865c expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.519665:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8890825b2b00) 00010000:00010000:0.0:1788305634.519668:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305634.519671:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8000, rc 0) 00000100:00100000:0.0:1788305634.519738:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12374:x1875173994223744:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 841us (1225us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788305634.519746:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 190 00000100:00100000:2.0:1788305634.522745:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.522880:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224000 00000100:00100000:3.0:1788305634.522899:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224000 00000100:00100000:3.0:1788305634.522961:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:3.0:1788305634.522971:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12374:x1875173994224000:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.523054:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305634.523081:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e6054192 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0865c expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523100:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8890825b2b00) 00010000:00010000:3.0:1788305634.523111:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305634.523139:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523154:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523163:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523177:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523184:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523191:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523234:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523241:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523247:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523253:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.523257:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523265:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523314:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305634.523317:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305634.523320:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523326:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523335:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523340:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523346:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523351:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.523353:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523359:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523365:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x1d492605 (ffff8890825b7100) 00010000:00010000:3.0:1788305634.523367:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305634.523369:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.523374:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541a7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x1d492605 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.523458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8d45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994224000:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 488us (723us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305634.523465:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 191 00000100:00100000:2.0:1788305634.533829:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.534785:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224128 00000100:00100000:1.0:1788305634.534796:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224128 00000100:00100000:1.0:1788305634.534858:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:1.0:1788305634.534877:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12374:x1875173994224128:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305634.534907:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305634.534934:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08663 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.534971:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.534998:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.535010:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.535117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.535133:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.535141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305634.535144:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305634.535147:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:1.0:1788305634.535211:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12374:x1875173994224128:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 344us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.535218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 192 00000100:00100000:0.0:1788305634.541648:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.541754:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224384 00000100:00100000:3.0:1788305634.541765:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224384 00000100:00100000:3.0:1788305634.541827:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:3.0:1788305634.541838:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12374:x1875173994224384:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.541933:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.541949:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.541960:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305634.542136:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788305634.542146:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 464632870568ns, next at 465632867915ns, rc = 0 00000004:00010000:3.0:1788305634.542197:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000015c00852 reply state 00000000c8d73e2c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.542210:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.542218:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.542221:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788305634.542224:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305634.542436:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12374:x1875173994224384:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 599us (800us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788305634.542455:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 193 00000100:00100000:3.0:1788305634.544389:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.549133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224512 00000100:00100000:1.0:1788305634.549148:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224512 00000100:00100000:1.0:1788305634.549224:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:1.0:1788305634.549235:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12374:x1875173994224512:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305634.549259:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305634.549303:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0866a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.549359:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.549382:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.549404:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305634.549407:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305634.549410:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:1.0:1788305634.549475:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12374:x1875173994224512:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 242us (5100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.549483:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 194 00000100:00100000:1.0:1788305634.554245:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.554383:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224640 00000100:00100000:0.0:1788305634.554393:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224640 00000100:00100000:0.0:1788305634.554468:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305634.554480:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+6:2395:x1875173994224640:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788305634.554493:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305634.554703:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994224640:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 224us (466us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788305634.554711:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305634.559736:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.559849:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994224896 00000100:00100000:1.0:1788305634.559859:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994224896 00000100:00100000:1.0:1788305634.559950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788305634.559961:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12374:x1875173994224896:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788305634.560217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+69:12374:x1875173994224896:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 257us (489us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788305634.560225:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:0.0:1788305634.579027:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.580103:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225152 00000100:00100000:3.0:1788305634.580124:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225152 00000100:00100000:3.0:1788305634.581380:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:3.0:1788305634.581399:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+69:12374:x1875173994225152:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305634.581586:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+69:12374:x1875173994225152:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 193us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.581594:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 195 00000100:00100000:0.0:1788305634.588897:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.589249:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225280 00000100:00100000:3.0:1788305634.589262:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225280 00000100:00100000:3.0:1788305634.589825:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:3.0:1788305634.589841:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+69:12374:x1875173994225280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.589881:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305634.589911:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60541ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08671 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590014:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590034:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590048:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305634.590132:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305634.590160:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590199:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60541ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08671 expref: 71 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590236:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08671 expref: 70 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.590247:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.590250:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305634.590256:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305634.591203:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12374:x1875173994225280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1358us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.591216:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 196 00000100:00100000:1.0:1788305634.596149:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.596462:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225408 00000100:00100000:2.0:1788305634.596473:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225408 00000100:00100000:2.0:1788305634.596627:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:2.0:1788305634.596639:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994225408:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305634.596658:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305634.596680:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08678 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788305634.596707:0:8437:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9760e2, blocks: 0x0 00010000:00010000:2.0:1788305634.596726:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1788305634.596731:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305634.596741:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.596759:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 8 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.596774:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21400, rc 0) 00000100:00100000:2.0:1788305634.596839:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb763c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994225408:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 202us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.596878:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:1.0:1788305634.604939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.604983:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225664 00000100:00100000:1.0:1788305634.604992:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225664 00000100:00100000:1.0:1788305634.605041:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:1.0:1788305634.605052:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12374:x1875173994225664:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788305634.605158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12374:x1875173994225664:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.605175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 197 00000100:00100000:3.0:1788305634.613160:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.613547:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225792 00000100:00100000:0.0:1788305634.613557:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225792 00000100:00100000:0.0:1788305634.613613:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:0.0:1788305634.613623:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:12374:x1875173994225792:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305634.613639:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305634.613656:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0867f expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.613687:0:8758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.613696:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305634.613700:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305634.613706:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.613755:0:8758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 9 pid: 8437 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.613770:0:8758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 9 pid: 8437 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.613786:0:8758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8758:1875174015256704:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305634.614157:0:8758:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305634.634303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.634347:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994225920 00000100:00100000:1.0:1788305634.634355:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994225920 00010000:00010000:1.0:1788305634.634398:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 10 pid: 8437 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.634436:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788305634.634446:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2395:x1875173994225920:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305634.634463:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305634.634485:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 10 pid: 8437 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.634499:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 10 pid: 8437 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.634530:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305634.634535:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305634.634544:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 10 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.634555:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 10 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.634600:0:7471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 10 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.634626:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083edad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7471:1875174015256832:192.168.202.55@tcp:105: 00000100:00100000:1.0:1788305634.634715:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb040c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788305634.637693:0:8758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007bb345f9/0x4a426866e60541d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08678 expref: 10 pid: 8437 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305634.637716:0:8758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8758:1875174015256704:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305634.637747:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.637762:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8a00, rc 0) 00000100:00100000:2.0:1788305634.637838:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:12374:x1875173994225792:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 24215us (24683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.638554:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788305634.647506:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.647570:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083edad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7471:1875174015256832:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788305634.647593:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305634.647658:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994225920:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 13213us (13385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.647669:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 88 00000100:00100000:1.0:1788305634.647743:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226048 00000100:00100000:1.0:1788305634.647749:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226048 00002000:00100000:1.0:1788305634.647790:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff889083ed8a80 x1875173994226048/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:565/0 lens 504/0 e 0 to 0 dl 1788305645 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788305634.647800:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083ed8a80 with x1875173994226048 ext(0->8) 00002000:00010000:1.0:1788305634.647806:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889083ed8a80 00000100:00100000:1.0:1788305634.647827:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:1.0:1788305634.647836:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994226048:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788305634.652264:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2396:x1875173994226048:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 4417us (4755us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788305634.652293:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00002000:00100000:1.0:1788305634.652306:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff889083ed8a80 x1875173994226048/t4294967315(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:565/0 lens 504/448 e 0 to 0 dl 1788305645 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788305634.652316:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083ed8a80 with x1875173994226048 ext(0->8) 00002000:00010000:1.0:1788305634.652337:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889083ed8a80 00000100:00100000:1.0:1788305634.659576:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.659670:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226176 00000100:00100000:3.0:1788305634.659679:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226176 00000100:00100000:3.0:1788305634.659742:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 198 00000100:00100000:3.0:1788305634.659753:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12374:x1875173994226176:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788305634.678178:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788305634.678196:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:0.0:1788305634.678259:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788305634.678307:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff889182f61840 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788305634.678312:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2a2c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff889182f613c0 00000020:00080000:0.0:1788305634.678314:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2a2300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8890827cec00 00010000:00010000:1.0:1788305634.678371:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678383:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678391:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678397:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678402:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678409:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678427:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8891885c8500) 00010000:00010000:1.0:1788305634.678430:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678435:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678441:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e6053f07 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678462:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678467:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678489:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678494:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678496:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678502:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678511:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305634.678513:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678516:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678522:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6053f0e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678540:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678545:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678550:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678554:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678556:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678572:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678580:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:1.0:1788305634.678582:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678585:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678591:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6053f4d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678604:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678610:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678616:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678621:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678623:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678629:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678636:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305634.678652:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678655:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678670:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054050 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678682:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678687:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678693:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678697:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678700:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678705:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678712:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305634.678715:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678717:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678724:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054073 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678734:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678740:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678751:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678756:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678759:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678764:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678772:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305634.678774:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305634.678777:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678781:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60540b9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678793:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678799:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678804:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678809:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305634.678812:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678828:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678837:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:1.0:1788305634.678839:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788305634.678842:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.678847:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e60541bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.681364:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015256960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788305634.681366:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015257088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788305634.684581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305634.684793:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015257088 00000100:00100000:3.0:1788305634.684804:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015257088 00000100:00100000:1.0:1788305634.685449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305634.685513:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015256960 00000100:00100000:3.0:1788305634.685527:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015256960 00000100:00100000:1.0:1788305634.685549:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305634.685563:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015257088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788305634.685600:0:8435:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1788305634.685635:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9760de, atime: 0x6a9760df, ctime: 0x6a9760de, blocks: 0x8 00010000:00010000:1.0:1788305634.685643:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.685661:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1788305634.685666:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305634.685672:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.685689:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.685712:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.685719:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.685738:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305634.686203:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788305634.686216:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015256960:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788305634.686580:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015257088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1020us (2006us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788305634.686588:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:1.0:1788305634.686615:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305634.686622:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.686633:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305634.686639:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.686648:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.686668:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.686676:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e60541e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.686706:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305634.686708:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305634.686710:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305634.687242:0:8436:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788305634.687247:0:8436:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788305634 00002000:00010000:3.0:1788305634.687250:0:8436:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788305634.687252:0:8436:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788305634 -> 1788305634 00002000:00010000:3.0:1788305634.687254:0:8436:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788305634.687325:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015256960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1112us (1878us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788305634.687334:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788305634.687356:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305634.687360:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788305634.687369:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788305634.687409:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788305634.687506:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12374:x1875173994226176:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 27754us (27939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.687515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 198 00000004:00080000:3.0:1788305634.687684:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff88918caaa300/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788305634.687692:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015257088:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1788305634.689250:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891bb097800/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788305634.689263:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015256960:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788305634.706154:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.706646:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226304 00000100:00100000:2.0:1788305634.706658:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226304 00000100:00100000:2.0:1788305634.708883:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:2.0:1788305634.708905:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2396:x1875173994226304:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788305634.715444:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1788305634.715461:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788305634.716045:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994226304:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 7143us (9895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.716056:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:1.0:1788305634.734678:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.734929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226560 00000100:00100000:3.0:1788305634.734940:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226560 00000100:00100000:3.0:1788305634.734999:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00100000:3.0:1788305634.735009:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12374:x1875173994226560:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.735063:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305634.735095:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60541d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08671 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.735114:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.735119:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305634.735149:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.735162:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.735171:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305634.735933:0:6520:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000505ee034 reply state 00000000f293867f transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.735950:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.735959:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.735962:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305634.735966:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305634.736096:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:12374:x1875173994226560:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 1085us (1426us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788305634.736104:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 199 00000100:00100000:2.0:1788305634.742059:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.742456:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226688 00000100:00100000:3.0:1788305634.742465:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226688 00000100:00100000:2.0:1788305634.742724:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:2.0:1788305634.742738:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994226688:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788305634.743121:0:8758:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788305634.743135:0:8758:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788305634 -> 1788305633 00002000:00010000:2.0:1788305634.743139:0:8758:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788305631 00002000:00010000:2.0:1788305634.743141:0:8758:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788305634 -> 1788305633 00002000:00010000:2.0:1788305634.743143:0:8758:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788305634.743221:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994226688:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 486us (1172us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788305634.743231:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:3.0:1788305634.747848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.747915:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994226944 00000100:00100000:0.0:1788305634.747925:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994226944 00000100:00100000:0.0:1788305634.747989:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00100000:0.0:1788305634.748000:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:12374:x1875173994226944:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788305634.748070:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.748087:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.748108:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.748144:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.748158:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 20 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.748175:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015257216:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305634.748270:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305634.759895:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015257216:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305634.759923:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.761400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.761556:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227072 00000100:00100000:0.0:1788305634.761565:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227072 00010000:00010000:0.0:1788305634.761605:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 21 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.761649:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 89 00000100:00100000:0.0:1788305634.761659:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:2396:x1875173994227072:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305634.761674:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305634.761682:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 21 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761717:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 21 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761739:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60541b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08663 expref: 21 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761754:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305634.761759:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761768:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761775:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761799:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305634.761858:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:2396:x1875173994227072:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 200us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305634.761876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 89 00010000:00010000:0.0:1788305634.761905:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761913:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761952:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761969:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761974:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761980:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305634.761984:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.761991:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.762000:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305634.762003:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788305634.762006:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.762011:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9a00/0x4a426866e60541f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.762049:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12374:x1875173994226944:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 14051us (14212us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788305634.762057:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 200 00000100:00100000:1.0:1788305634.769220:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305634.772091:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227200 00000100:00100000:2.0:1788305634.772106:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227200 00000100:00100000:2.0:1788305634.772179:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788305634.772191:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994227200:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788305634.772239:0:8436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.772260:0:8436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 8 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.772269:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305634.772296:0:8436:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305634.772301:0:8436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.772339:0:8436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 8 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.772352:0:8436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 8 pid: 8758 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305634.772383:0:8436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015257344:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305634.772482:0:8436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891839589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305634.786079:0:8436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8436:1875174015257344:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305634.786109:0:8436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.787219:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.787540:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227328 00000100:00100000:3.0:1788305634.787561:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227328 00010000:00010000:2.0:1788305634.787793:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305634.787991:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 90 00000100:00100000:2.0:1788305634.788002:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994227328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305634.788020:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305634.788044:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.788059:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.788079:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f73f17d/0x4a426866e60541df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0867f expref: 9 pid: 8758 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.788096:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305634.788100:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788305634.788113:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.788123:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305634.788199:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305634.788254:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994227328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 253us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.788262:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 90 00010000:00010000:3.0:1788305634.788450:0:8436:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788460:0:8436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788480:0:8436:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788489:0:8436:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788497:0:8436:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788505:0:8436:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305634.788509:0:8436:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788518:0:8436:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788530:0:8436:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.788538:0:8436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c34b515/0x4a426866e60541fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.789786:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994227200:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 17589us (20564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305634.789798:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788305634.810523:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305634.810596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227584 00000100:00100000:3.0:1788305634.810605:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227584 00000100:00100000:3.0:1788305634.810663:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 201 00000100:00100000:3.0:1788305634.810674:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12374:x1875173994227584:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788305634.810751:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.810768:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.810778:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.810812:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 19 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.810826:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 19 pid: 10615 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.810853:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257472:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305634.810954:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305634.816069:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257472:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305634.816115:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.817863:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.818256:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227712 00000100:00100000:1.0:1788305634.818266:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227712 00010000:00010000:1.0:1788305634.818351:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 20 pid: 10615 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305634.818387:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 91 00000100:00100000:1.0:1788305634.818397:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:2395:x1875173994227712:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305634.818411:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305634.818417:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 20 pid: 10615 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818431:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 20 pid: 10615 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818451:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054049 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08608 expref: 20 pid: 10615 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818468:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:1.0:1788305634.818485:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818495:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818501:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.818520:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305634.818589:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:2395:x1875173994227712:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 193us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305634.818596:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 91 00010000:00010000:3.0:1788305634.819075:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819085:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819257:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819269:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819319:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819350:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.819362:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 19 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.819375:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257600:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305634.819446:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891852e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305634.834146:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257600:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305634.834175:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305634.836152:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.836339:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227840 00000100:00100000:0.0:1788305634.836349:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227840 00010000:00010000:0.0:1788305634.836390:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 20 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.836447:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 92 00000100:00100000:0.0:1788305634.836458:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:2395:x1875173994227840:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305634.836475:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305634.836482:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 20 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836495:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 20 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836517:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e60541c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0866a expref: 20 pid: 6519 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836533:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305634.836538:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836547:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836554:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.836595:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305634.836657:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:2395:x1875173994227840:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 200us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305634.836664:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 92 00010000:00010000:3.0:1788305634.836847:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.836857:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305634.836990:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788305634.837109:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:3.0:1788305634.837142:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788305634.837218:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875174015257728:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788305634.837267:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305634.837346:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305634.837481:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015257728 00000100:00100000:2.0:1788305634.837488:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015257728 00000100:00100000:2.0:1788305634.837520:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788305634.837527:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875174015257728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788305634.837611:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1875174015257728:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305634.837618:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788305634.837755:0:6521:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:3.0:1788305634.837761:0:6521:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891bb097800, transno 4294967316 00000100:00100000:3.0:1788305634.837781:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875174015257728:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788305634.838103:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:3.0:1788305634.838144:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875174015257856:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788305634.838172:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305634.838200:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305634.838354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015257856 00000100:00100000:2.0:1788305634.838360:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015257856 00000100:00100000:2.0:1788305634.838398:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788305634.838407:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1875174015257856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788305634.838503:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1875174015257856:12345-0@lo:1000:mdt00_002.0 Request processed in 97us (330us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788305634.838510:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788305634.838677:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6521:1875174015257856:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788305634.838711:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838719:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838726:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838748:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.838752:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838759:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838773:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.838776:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305634.838780:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838786:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054209 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838808:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838815:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838821:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838825:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.838828:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.838834:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839179:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.839181:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305634.839186:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839191:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605413e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839214:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839226:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839235:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839264:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.839506:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 22 pid: 6520 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.839520:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257984:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305634.847081:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788305634.860682:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015257984:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305634.860713:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305634.860907:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305634.861154:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994227968 00000100:00100000:0.0:1788305634.861168:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994227968 00010000:00010000:0.0:1788305634.861207:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 23 pid: 6520 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305634.861251:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 93 00000100:00100000:0.0:1788305634.861260:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:2396:x1875173994227968:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305634.861313:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305634.861322:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 23 pid: 6520 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861334:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 23 pid: 6520 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861357:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605415a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0864e expref: 23 pid: 6520 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861374:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:0.0:1788305634.861378:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861388:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861396:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305634.861418:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305634.861470:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2396:x1875173994227968:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 209us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305634.861487:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 93 00010000:00010000:3.0:1788305634.861858:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861876:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861887:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861893:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861900:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861913:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.861917:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861923:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861933:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.861935:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305634.861938:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861944:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054210 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861953:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861965:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861970:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861975:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305634.861977:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861982:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861989:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff88908362e600) 00010000:00010000:3.0:1788305634.861991:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305634.861993:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.861999:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054202 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305634.862146:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12374:x1875173994227584:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 51472us (51630us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788305634.862154:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 201 00000020:00080000:3.0:1788305634.862158:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788305634.862383:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305634.862388:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305634.862913:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788305634.862923:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788305634.883313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305634.883423:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994228224 00000100:00100000:1.0:1788305634.883433:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994228224 00000100:00100000:1.0:1788305634.883483:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788305634.883494:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12374:x1875173994228224:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788305634.883793:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788305634.883826:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788305634.883998:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884014:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884024:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884032:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884047:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884053:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305634.884077:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788305634.884176:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:12374:x1875173994228224:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 682us (871us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788305634.884184:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000020:00080000:1.0:1788305634.884189:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788305634.884530:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305634.884538:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.884559:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305634.884563:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.884584:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.884599:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:3.0:1788305634.884602:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788305634.884606:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.884611:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054217 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305634.884631:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305634.884634:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305634.884636:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305635.083852:0:14666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305635.083860:0:14666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305635.085458:0:14666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788305635.085466:0:14666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788305635.376545:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.376580:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994228480 00000100:00100000:2.0:1788305635.376589:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994228480 00000100:00100000:2.0:1788305635.376787:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:2.0:1788305635.376801:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:12384:x1875173994228480:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305635.376825:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305635.376844:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605421e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08686 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.376964:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20e00/0x4a426866e6054225 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.376978:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20e00/0x4a426866e6054225 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.376990:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20e00/0x4a426866e6054225 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305635.377001:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788305635.377095:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605421e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08686 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.377111:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20e00/0x4a426866e6054225 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08686 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.377120:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305635.377123:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788305635.377126:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20e00, rc 0) 00000100:00100000:2.0:1788305635.377183:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12384:x1875173994228480:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 385us (646us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788305635.377201:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 202 00000100:00100000:0.0:1788305635.388931:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.388968:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994228608 00000100:00100000:0.0:1788305635.388977:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994228608 00000100:00100000:0.0:1788305635.389026:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 203 00000100:00100000:0.0:1788305635.389035:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12384:x1875173994228608:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:0.0:1788305635.389105:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389121:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389132:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389146:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389154:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389160:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389239:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389261:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389269:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305635.389350:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389362:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389368:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389375:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389381:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305635.389385:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389392:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389404:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305635.389407:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305635.389411:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389417:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054233 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389436:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389442:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389448:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389454:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305635.389456:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389462:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389470:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889186383700) 00010000:00010000:0.0:1788305635.389473:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305635.389475:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389481:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e605423a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389496:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389502:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389507:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389518:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305635.389521:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389528:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389536:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff889186383600) 00010000:00010000:0.0:1788305635.389539:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305635.389541:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.389546:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054241 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305635.389621:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12384:x1875173994228608:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 586us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.389630:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 203 00010000:00010000:3.0:1788305635.413492:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305635.447596:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305635.448911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994228864 00000100:00100000:3.0:1788305635.448925:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994228864 00000100:00100000:3.0:1788305635.448992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:3.0:1788305635.449002:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12387:x1875173994228864:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305635.449022:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305635.449041:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054248 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0868d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449128:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449142:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449154:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449169:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449177:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449184:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449313:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449322:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449330:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305635.449340:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788305635.449416:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449423:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449436:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449442:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305635.449447:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449454:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449467:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305635.449470:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305635.449474:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449480:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e605424f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449492:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449499:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449504:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449509:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305635.449512:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449527:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449535:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8890825b7f00) 00010000:00010000:3.0:1788305635.449538:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305635.449541:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449547:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054256 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449587:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054248 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449600:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.449607:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:3.0:1788305635.449610:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305635.449612:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519c00, rc 0) 00000100:00100000:3.0:1788305635.449677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12387:x1875173994228864:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 677us (2089us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788305635.449685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 204 00000100:00100000:2.0:1788305635.455016:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305635.459615:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994228992 00000100:00100000:3.0:1788305635.459631:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994228992 00000100:00100000:3.0:1788305635.459691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:3.0:1788305635.459700:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12387:x1875173994228992:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788305635.459782:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459807:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459840:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459846:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459852:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459858:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305635.459874:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459881:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459891:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:3.0:1788305635.459894:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305635.459898:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.459905:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605426b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.459989:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12387:x1875173994228992:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 289us (4983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.459996:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 205 00000100:00100000:3.0:1788305635.463051:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.464175:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994229248 00000100:00100000:0.0:1788305635.464187:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994229248 00000100:00100000:0.0:1788305635.464517:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:0.0:1788305635.464529:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12387:x1875173994229248:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305635.464878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:12387:x1875173994229248:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 350us (1834us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788305635.464886:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788305635.505927:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.506083:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994229504 00000100:00100000:0.0:1788305635.506093:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994229504 00000100:00100000:0.0:1788305635.506168:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:0.0:1788305635.506178:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:11919:x1875173994229504:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305635.506201:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.506221:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054272 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08694 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.506386:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.506402:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.506412:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.506450:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.506463:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 29 pid: 6519 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305635.506477:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015258112:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305635.506581:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa143c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305635.511051:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015258112:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305635.511079:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.511251:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.511425:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994229632 00000100:00100000:0.0:1788305635.511446:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994229632 00010000:00010000:0.0:1788305635.511479:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 30 pid: 6519 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305635.511527:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 94 00000100:00100000:0.0:1788305635.511536:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:2396:x1875173994229632:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305635.511551:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305635.511559:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 30 pid: 6519 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511573:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 30 pid: 6519 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511595:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605425d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0868d expref: 30 pid: 6519 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511612:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:0.0:1788305635.511617:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511627:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511634:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.511662:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305635.511718:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:2396:x1875173994229632:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 182us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.511736:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 94 00010000:00010000:1.0:1788305635.511806:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.511814:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305635.511833:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788305635.511975:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054272 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 30 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.511991:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 29 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.511998:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:1.0:1788305635.512001:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305635.512003:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8400, rc 0) 00000100:00100000:1.0:1788305635.512028:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:11919:x1875173994229504:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5852us (6112us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788305635.512043:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 206 00000100:00100000:2.0:1788305635.516334:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305635.517491:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994229760 00000100:00100000:3.0:1788305635.517504:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994229760 00000100:00100000:3.0:1788305635.517585:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:3.0:1788305635.517596:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:11919:x1875173994229760:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305635.517620:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305635.517642:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054287 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0869b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.517883:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20a00/0x4a426866e605428e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.517898:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20a00/0x4a426866e605428e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.517911:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20a00/0x4a426866e605428e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.518033:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054287 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0869b expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.518052:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20a00/0x4a426866e605428e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0869b expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.518061:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:2.0:1788305635.518064:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305635.518068:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20a00, rc 0) 00000100:00100000:2.0:1788305635.518136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11919:x1875173994229760:12345-192.168.202.55@tcp:101:bash.0 Request processed in 542us (1812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305635.518144:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 207 00000100:00100000:3.0:1788305635.528728:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.529774:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230016 00000100:00100000:2.0:1788305635.529787:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230016 00000100:00100000:1.0:1788305635.529917:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 208 00000100:00100000:1.0:1788305635.529932:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:11919:x1875173994230016:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:1.0:1788305635.530161:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.530178:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.530190:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305635.530231:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788305635.530253:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000085709d0f reply state 00000000b143b6ef transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.530264:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.530271:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:1.0:1788305635.530293:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305635.530297:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788305635.530367:0:10615:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788305635.530471:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:11919:x1875173994230016:12345-192.168.202.55@tcp:36:bash.0 Request processed in 542us (1750us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788305635.530479:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 208 00000020:00080000:1.0:1788305635.530484:0:10615:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788305635.536133:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.536318:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230144 00000100:00100000:0.0:1788305635.536330:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230144 00000100:00100000:0.0:1788305635.537166:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:0.0:1788305635.537178:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+34:11919:x1875173994230144:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305635.537208:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.537229:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605429c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086a2 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.537313:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605429c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a2 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.537328:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605429c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a2 expref: 35 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.537784:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:0.0:1788305635.537789:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305635.537793:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305635.538028:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:11919:x1875173994230144:12345-192.168.202.55@tcp:101:bash.0 Request processed in 850us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.538036:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 209 00000100:00100000:2.0:1788305635.543524:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.544082:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230272 00000100:00100000:0.0:1788305635.544092:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230272 00000100:00100000:0.0:1788305635.544152:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788305635.544162:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:11919:x1875173994230272:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305635.544180:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.544212:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086a9 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305635.544233:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9760e1, atime: 0x6a9760df, ctime: 0x6a9760e1, blocks: 0x8 00010000:00010000:0.0:1788305635.549444:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788305635.549456:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305635.549470:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.549496:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.549513:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8200, rc 0) 00000100:00100000:0.0:1788305635.549768:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:11919:x1875173994230272:12345-192.168.202.55@tcp:101:bash.0 Request processed in 5603us (6250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.549777:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:3.0:1788305635.555525:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.555636:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230400 00000100:00100000:2.0:1788305635.555660:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230400 00002000:00010000:2.0:1788305635.555698:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788305635.555703:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bfaa7800 with x1875173994230400 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305635.555715:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bfaa7800. 00000100:00100000:2.0:1788305635.555752:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788305635.555762:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994230400:12345-192.168.202.55@tcp:10:bash.0 00002000:00010000:2.0:1788305635.556030:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788305635.556034:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788305633 -> 1788305635 00002000:00010000:2.0:1788305635.556036:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788305631 -> 1788305631 00002000:00010000:2.0:1788305635.556038:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788305633 -> 1788305635 00002000:00010000:2.0:1788305635.556040:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788305635.556103:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994230400:12345-192.168.202.55@tcp:10:bash.0 Request processed in 342us (586us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788305635.556111:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00002000:00010000:2.0:1788305635.556115:0:8443:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788305635.556118:0:8443:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bfaa7800 with x1875173994230400 ext(0->18446744073709551615) 00002000:00010000:2.0:1788305635.556122:0:8443:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bfaa7800. 00000100:00100000:3.0:1788305635.631391:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.631457:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230528 00000100:00100000:2.0:1788305635.631468:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230528 00000100:00100000:2.0:1788305635.631695:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:2.0:1788305635.631707:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:12400:x1875173994230528:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788305635.631781:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631799:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631829:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631847:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631854:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631870:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631945:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631955:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.631962:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305635.632008:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632019:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632024:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632030:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632045:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305635.632049:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632057:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632069:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305635.632072:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305635.632077:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632083:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e60542aa lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632097:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632103:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632109:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632114:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305635.632117:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632121:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632137:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88908362ea00) 00010000:00010000:2.0:1788305635.632139:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305635.632142:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632161:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20000/0x4a426866e60542b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632174:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632181:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632186:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632191:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305635.632194:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632199:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632205:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:2.0:1788305635.632207:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305635.632209:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.632214:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e60542b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305635.632471:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:12400:x1875173994230528:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 764us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305635.632479:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 210 00000100:00100000:3.0:1788305635.681534:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.681638:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230784 00000100:00100000:0.0:1788305635.681648:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230784 00000100:00100000:0.0:1788305635.681717:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:0.0:1788305635.681727:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+35:12404:x1875173994230784:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305635.681748:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.681769:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60542bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086b0 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681854:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681896:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681910:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681928:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681936:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.681942:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682046:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60542d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682056:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60542d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682063:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60542d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305635.682072:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788305635.682169:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682176:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682183:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682195:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305635.682200:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682209:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682223:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305635.682227:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305635.682232:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682238:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682254:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682259:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682264:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682270:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305635.682340:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682348:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682367:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889186383e00) 00010000:00010000:0.0:1788305635.682369:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305635.682372:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682378:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682418:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60542bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b0 expref: 38 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682433:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60542d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b0 expref: 37 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.682440:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:0.0:1788305635.682443:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788305635.682445:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8600, rc 0) 00000100:00100000:0.0:1788305635.682511:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12404:x1875173994230784:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 784us (986us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788305635.682518:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 211 00000100:00100000:3.0:1788305635.687396:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.687733:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994230912 00000100:00100000:1.0:1788305635.687743:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994230912 00000100:00100000:1.0:1788305635.687818:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:1.0:1788305635.687827:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12404:x1875173994230912:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:1.0:1788305635.687903:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.687917:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 37 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.687924:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.687950:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 37 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.687960:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 37 pid: 10615 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305635.687970:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015258240:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305635.688046:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1788305635.691153:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015258240:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305635.691180:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.694362:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.694488:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994231168 00000100:00100000:1.0:1788305635.694498:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994231168 00000100:00100000:1.0:1788305635.694550:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:1.0:1788305635.694560:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:6169:x1875173994231168:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788305635.694886:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:6169:x1875173994231168:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 325us (531us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788305635.694907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:3.0:1788305635.700885:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.701037:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994231296 00000100:00100000:1.0:1788305635.701047:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994231296 00010000:00010000:1.0:1788305635.701092:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 39 pid: 10615 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305635.701141:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 95 00000100:00100000:1.0:1788305635.701161:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:2395:x1875173994231296:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305635.701176:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305635.701182:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 39 pid: 10615 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701197:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 39 pid: 10615 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701221:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054279 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08694 expref: 39 pid: 10615 timeout: 565 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701237:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:1.0:1788305635.701243:0:6506:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701252:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701259:0:6506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.701378:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305635.701432:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:2395:x1875173994231296:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 272us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.701440:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 95 00010000:00010000:3.0:1788305635.702673:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702744:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702803:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702811:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702818:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702824:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305635.702829:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702916:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702931:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:3.0:1788305635.702934:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305635.702938:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.702944:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e60542e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.703076:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12404:x1875173994230912:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 15245us (15687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.703085:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 212 00000100:00100000:3.0:1788305635.710450:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.710619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994231552 00000100:00100000:1.0:1788305635.710638:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994231552 00000100:00100000:1.0:1788305635.710705:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788305635.710715:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+37:12404:x1875173994231552:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:1.0:1788305635.710958:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:12404:x1875173994231552:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 243us (517us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788305635.710966:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:2.0:1788305635.797909:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015258496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305635.797988:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305635.798061:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305635.798068:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015258368:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305635.798094:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798407:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015259008:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798460:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015259520:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798485:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798499:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015260032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798539:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788305635.798544:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015258880:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798564:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798577:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015259392:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798597:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798610:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015259904:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798643:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305635.798685:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259008 00000100:00100000:1.0:1788305635.798692:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259008 00000100:00100000:1.0:1788305635.798734:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788305635.798744:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015259008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798796:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015259008:12345-0@lo:400:kworker.0 Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.798803:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788305635.798840:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015259008:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798874:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259520 00000100:00100000:1.0:1788305635.798878:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259520 00000100:00100000:1.0:1788305635.798906:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015258880 00000100:00100000:1.0:1788305635.798909:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015258880 00000100:00100000:1.0:1788305635.798919:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259392 00000100:00100000:1.0:1788305635.798921:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259392 00000100:00100000:1.0:1788305635.798933:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259904 00000100:00100000:1.0:1788305635.798936:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259904 00000100:00100000:1.0:1788305635.798948:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788305635.798955:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015259520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.798992:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015259520:12345-0@lo:400:kworker.0 Request processed in 38us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.798999:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788305635.799010:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788305635.799016:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015258880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.799042:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015258880:12345-0@lo:400:kworker.0 Request processed in 26us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.799048:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788305635.799059:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788305635.799064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015259392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.799101:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015259392:12345-0@lo:400:kworker.0 Request processed in 36us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.799107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788305635.799120:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788305635.799126:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015259904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.799164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015259904:12345-0@lo:400:kworker.0 Request processed in 39us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305635.799170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788305635.799196:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015258880:0@lo:400:kworker.0 00000100:00100000:1.0:1788305635.799206:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015259392:0@lo:400:kworker.0 00010000:00080000:1.0:1788305635.799218:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890836e1f80 x1875174015259904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305635.799227:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015259904:0@lo:400:kworker.0 00010000:00080000:1.0:1788305635.799238:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8000 x1875174015259520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305635.799246:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015259520:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.799665:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015258496 00000100:00100000:3.0:1788305635.799671:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015258496 00000100:00100000:3.0:1788305635.799716:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015258368 00000100:00100000:3.0:1788305635.799720:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015258368 00000100:00100000:3.0:1788305635.799737:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788305635.799744:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875174015258496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305635.799768:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305635.799817:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1875174015258496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.799824:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788305635.799851:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788305635.799867:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015258368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305635.799879:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788305635.799908:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015258368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.799914:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788305635.799937:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015258752:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.799971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305635.800008:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015259264:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800033:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305635.800048:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015259776:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800070:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305635.800076:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259264 00000100:00100000:0.0:1788305635.800081:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259264 00000100:00100000:3.0:1788305635.800088:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788305635.800093:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015258624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305635.800107:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788305635.800114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305635.800114:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015259264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800130:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015259136:0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800147:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015259264:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.800153:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788305635.800164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305635.800183:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015259648:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305635.800206:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259776 00000100:00100000:0.0:1788305635.800208:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259776 00000100:00100000:0.0:1788305635.800226:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259136 00000100:00100000:0.0:1788305635.800229:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259136 00000100:00100000:3.0:1788305635.800230:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015259264:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800239:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305635.800240:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788305635.800245:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015260160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305635.800246:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015259776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800266:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305635.800271:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015259776:12345-0@lo:400:kworker.0 Request processed in 26us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.800293:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788305635.800303:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015259776:0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800305:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788305635.800311:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015259136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800324:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015260032 00000100:00100000:3.0:1788305635.800328:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015260032 00000100:00100000:0.0:1788305635.800342:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015259136:12345-0@lo:400:kworker.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.800347:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788305635.800362:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015258624 00000100:00100000:3.0:1788305635.800363:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015259648 00000100:00100000:3.0:1788305635.800365:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015259648 00000100:00100000:0.0:1788305635.800365:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015258624 00000100:00100000:0.0:1788305635.800376:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015260160 00000100:00100000:0.0:1788305635.800379:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015260160 00000100:00100000:3.0:1788305635.800381:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788305635.800387:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015260032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800388:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788305635.800393:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015258624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305635.800401:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305635.800417:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3650:x1875174015260032:12345-0@lo:400:kworker.0 Request processed in 30us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.800421:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890833be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015258624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.800423:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788305635.800427:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788305635.800435:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305635.800435:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788305635.800441:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015259648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800441:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015260160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305635.800450:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788305635.800465:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015259648:12345-0@lo:400:kworker.0 Request processed in 26us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.800471:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788305635.800475:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015260160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.800480:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1788305635.800486:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305635.800490:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305635.800493:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305635.800495:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305635.800504:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015258752 00000100:00100000:0.0:1788305635.800505:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015260160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305635.800507:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015258752 00000100:00100000:0.0:1788305635.800516:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015258624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305635.800524:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015259136:0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800532:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015259648:0@lo:400:kworker.0 00000100:00100000:3.0:1788305635.800536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788305635.800540:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015258752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800603:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015260032:0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.800842:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015258368:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305635.805734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015258752:12345-0@lo:400:kworker.0 Request processed in 208us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.805750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788305635.805876:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015258752:0@lo:400:kworker.0 00000100:00100000:0.0:1788305635.807637:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890836bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015258496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305635.831638:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305635.831790:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994231808 00000100:00100000:0.0:1788305635.831800:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994231808 00000100:00100000:0.0:1788305635.831874:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:0.0:1788305635.831885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+38:12415:x1875173994231808:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:0.0:1788305635.831911:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.831933:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60542e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086b7 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832012:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832027:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832038:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832067:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832074:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832081:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832204:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e60542fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832213:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e60542fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.832220:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e60542fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305635.832230:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788305635.832608:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832627:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832634:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832640:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305635.832644:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832652:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832665:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305635.832668:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305635.832673:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832687:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e60542f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832702:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832707:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832713:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832719:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305635.832722:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832728:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832736:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff889186383e00) 00010000:00010000:2.0:1788305635.832739:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305635.832742:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832748:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9200/0x4a426866e60542f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832789:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e60542e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b7 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832803:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e60542fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.832817:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:2.0:1788305635.832820:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305635.832823:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9400, rc 0) 00000100:00100000:2.0:1788305635.832899:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+40:12415:x1875173994231808:12345-192.168.202.55@tcp:101:cat.0 Request processed in 1014us (1279us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788305635.832907:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 213 00000100:00100000:3.0:1788305635.840174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.840359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232064 00000100:00100000:1.0:1788305635.840369:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232064 00000100:00100000:1.0:1788305635.840426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:1.0:1788305635.840436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+40:12415:x1875173994232064:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:1.0:1788305635.840718:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+41:12415:x1875173994232064:12345-192.168.202.55@tcp:35:cat.0 Request processed in 282us (569us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788305635.840725:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788305635.871080:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.871198:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232320 00000100:00100000:1.0:1788305635.871208:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232320 00000100:00100000:1.0:1788305635.871307:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:1.0:1788305635.871319:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+41:12416:x1875173994232320:12345-192.168.202.55@tcp:36:rm.0 00010000:00010000:1.0:1788305635.871390:0:10615:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788305635.871419:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9c00/0x4a426866e605429c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a2 expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871442:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e60542fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b7 expref: 40 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871455:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e60542d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086b0 expref: 39 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871466:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20a00/0x4a426866e605428e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0869b expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871476:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:1.0:1788305635.871480:0:10615:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305635.871503:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871516:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871526:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871540:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871563:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.871570:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872109:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872122:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872130:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305635.872463:0:10615:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788305635.872474:0:10615:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465963198155ns, next at 466963195759ns, rc = 0 00010000:00010000:1.0:1788305635.872522:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872532:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872541:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872549:0:10615:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872557:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872577:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872602:0:10615:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305635.872632:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872639:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872646:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872652:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305635.872657:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872665:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.872676:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:1.0:1788305635.872679:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788305635.873060:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873068:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51e00/0x4a426866e605431a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873088:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873095:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873108:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873114:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305635.873117:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873123:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873133:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305635.873136:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305635.873139:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873232:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305635.873239:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873246:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305635.873249:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873256:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873266:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:0.0:1788305635.873295:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305635.873299:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873305:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054321 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.873315:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305635.873317:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305635.873319:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305635.873436:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50c00/0x4a426866e605430c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305635.873449:0:10615:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019262dc0 reply state 00000000c9c378d7 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873462:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305635.873470:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:1.0:1788305635.873472:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305635.873475:0:10615:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305635.873556:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12416:x1875173994232320:12345-192.168.202.55@tcp:36:rm.0 Request processed in 2237us (2485us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788305635.873565:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 214 00000100:00100000:3.0:1788305635.944759:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.944954:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232576 00000100:00100000:2.0:1788305635.944966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232576 00000100:00100000:3.0:1788305635.945164:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:3.0:1788305635.945176:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+39:12422:x1875173994232576:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305635.945203:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305635.945225:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054328 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086be expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945366:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945381:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945394:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945406:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945414:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945435:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305635.945752:0:6521:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788305635.945911:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945920:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945927:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945955:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945962:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945969:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945975:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305635.945979:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945986:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.945999:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305635.946003:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305635.946012:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.946019:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e605432f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305635.946031:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004aac0485 reply state 000000003e704db7 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.946041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.946047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:3.0:1788305635.946049:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305635.946052:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305635.946075:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054328 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 42 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.946088:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 41 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.946095:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305635.946097:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305635.946099:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519c00, rc 0) 00000100:00100000:3.0:1788305635.946154:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12422:x1875173994232576:12345-192.168.202.55@tcp:101:bash.0 Request processed in 982us (1408us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788305635.946162:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 215 00000100:00100000:0.0:1788305635.950688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305635.950824:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232704 00000100:00100000:3.0:1788305635.950915:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232704 00000100:00080000:0.0:1788305635.951224:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305635.951435:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788305635.951448:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2397:x1875173994232704:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305635.951466:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305635.951487:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086c5 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305635.951512:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305635.951530:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=466s v=(0 0) 00010000:00010000:0.0:1788305635.951534:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305635.951544:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.951561:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305635.951576:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8000, rc 0) 00000100:00100000:0.0:1788305635.951813:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2397:x1875173994232704:12345-192.168.202.55@tcp:101:bash.0 Request processed in 367us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305635.951821:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788305635.955537:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305635.955723:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232832 00000100:00100000:2.0:1788305635.955733:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232832 00000100:00100000:2.0:1788305635.955823:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:2.0:1788305635.955843:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:12422:x1875173994232832:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305635.955869:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305635.955889:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086cc expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.955920:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 9 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.955929:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305635.955933:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305635.955939:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.955973:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 9 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.955999:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 9 pid: 8758 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305635.956013:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015260288:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305635.956115:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891839589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305635.961136:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305635.961444:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994232960 00000100:00100000:3.0:1788305635.961453:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994232960 00010000:00010000:3.0:1788305635.961509:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 10 pid: 8758 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.961558:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:3.0:1788305635.961569:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2395:x1875173994232960:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305635.961586:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305635.961610:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 10 pid: 8758 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.961636:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 10 pid: 8758 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.961661:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305635.961666:0:7471:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305635.961675:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.961687:0:7471:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305635.961724:0:7471:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 10 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305635.961738:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7471:1875174015260416:192.168.202.55@tcp:105: 00000100:00100000:3.0:1788305635.962205:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890826663c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788305635.964663:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000201dc856/0x4a426866e605434b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086c5 expref: 10 pid: 8758 timeout: 566 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305635.964690:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8437:1875174015260288:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305635.964722:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 9 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305635.964737:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21800, rc 0) 00000100:00100000:2.0:1788305635.964802:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890836bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:12422:x1875173994232832:12345-192.168.202.55@tcp:101:bash.0 Request processed in 8970us (9275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305635.964810:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788305635.967350:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7471:1875174015260416:192.168.202.55@tcp:105: 00010000:00010000:3.0:1788305635.967391:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305635.967448:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994232960:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 5880us (6321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305635.967460:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 96 00000100:00100000:0.0:1788305635.971483:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305635.971569:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994233216 00000100:00100000:1.0:1788305635.971580:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994233216 00000100:00100000:1.0:1788305635.971647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:1.0:1788305635.971659:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+42:12422:x1875173994233216:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:1.0:1788305635.971992:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:12422:x1875173994233216:12345-192.168.202.55@tcp:35:bash.0 Request processed in 335us (520us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788305635.971999:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:1.0:1788305636.249506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.249813:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994233344 00000100:00100000:2.0:1788305636.249823:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994233344 00000100:00100000:2.0:1788305636.249942:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00100000:2.0:1788305636.249954:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+43:12438:x1875173994233344:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305636.249984:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305636.250005:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e6054359 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086d3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250097:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250111:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250121:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305636.250178:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788305636.250182:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305636.250201:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250227:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e6054359 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086d3 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250246:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086d3 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.250254:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305636.250257:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305636.250261:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20600, rc 0) 00000100:00100000:2.0:1788305636.250381:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+44:12438:x1875173994233344:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 429us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305636.250388:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 216 00000100:00080000:0.0:1788305636.250721:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305636.260465:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305636.260794:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994233600 00000100:00100000:1.0:1788305636.260804:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994233600 00000100:00100000:1.0:1788305636.260877:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:1.0:1788305636.260889:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891863a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+44:12438:x1875173994233600:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305636.260909:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305636.260930:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054367 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086da expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.261044:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e605436e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.261059:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e605436e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.261071:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e605436e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305636.261082:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788305636.261186:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054367 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086da expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.261224:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e605436e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086da expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.261233:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:1.0:1788305636.261236:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305636.261239:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50600, rc 0) 00000100:00100000:1.0:1788305636.261546:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891863a5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:12438:x1875173994233600:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 658us (1088us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788305636.261554:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 217 00000100:00100000:0.0:1788305636.268835:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.268942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994233856 00000100:00100000:2.0:1788305636.268952:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994233856 00000100:00100000:2.0:1788305636.269025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:2.0:1788305636.269035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+46:12438:x1875173994233856:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305636.269060:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305636.269080:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605437c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086e1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.269170:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.269184:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.269195:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305636.269208:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788305636.269355:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605437c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e1 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.269369:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e1 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.269374:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:2.0:1788305636.269377:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788305636.269379:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20800, rc 0) 00000100:00100000:2.0:1788305636.269429:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:12438:x1875173994233856:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 396us (603us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788305636.269433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 218 00000100:00100000:0.0:1788305636.276099:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.276129:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.276196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234112 00000100:00100000:3.0:1788305636.276206:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234112 00000100:00100000:3.0:1788305636.276262:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788305636.276272:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2398:x1875173994234112:12345-192.168.202.55@tcp:1:lfs.0 00010000:00010000:3.0:1788305636.276365:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.276388:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.276397:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305636.276401:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305636.276406:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.276436:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.276446:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 8 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.276457:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1875174015260544:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305636.276548:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890826663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305636.276745:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994233984 00000100:00100000:2.0:1788305636.276755:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994233984 00000100:00100000:2.0:1788305636.276783:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305636.276788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+48:2398:x1875173994233984:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305636.276796:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305636.276814:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e605436e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086da expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.276826:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:2.0:1788305636.276832:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305636.276867:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:2398:x1875173994233984:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 78us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305636.276874:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305636.279359:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8435:1875174015260544:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305636.279390:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305636.280738:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305636.281202:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234240 00000100:00100000:1.0:1788305636.281211:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234240 00002000:00100000:1.0:1788305636.281263:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff889083792680 x1875173994234240/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:567/0 lens 504/0 e 0 to 0 dl 1788305647 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788305636.281447:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083792680 with x1875173994234240 ext(0->8) 00010000:00010000:1.0:1788305636.281457:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 9 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.281470:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 9 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305636.281475:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889083792680 00000100:00100000:1.0:1788305636.281498:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:1.0:1788305636.281506:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994234240:12345-192.168.202.55@tcp:4:lfs.0 00000100:00100000:1.0:1788305636.282566:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2395:x1875173994234240:12345-192.168.202.55@tcp:4:lfs.0 Request processed in 1056us (1829us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788305636.282581:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00002000:00100000:1.0:1788305636.282588:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff889083792680 x1875173994234240/t4294967309(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:567/0 lens 504/448 e 0 to 0 dl 1788305647 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788305636.282595:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889083792680 with x1875173994234240 ext(0->8) 00010000:00010000:1.0:1788305636.282600:0:8441:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.282610:0:8441:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305636.282623:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff889083792680 00000100:00100000:1.0:1788305636.285490:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.285561:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234368 00000100:00100000:0.0:1788305636.285569:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234368 00010000:00010000:0.0:1788305636.285606:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305636.285731:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 97 00000100:00100000:0.0:1788305636.285739:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2397:x1875173994234368:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305636.285751:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788305636.285766:0:10341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788305636.285768:0:10341:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788305635 00002000:00010000:0.0:1788305636.285770:0:10341:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788305635 00002000:00010000:0.0:1788305636.285771:0:10341:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788305635 00002000:00010000:0.0:1788305636.285773:0:10341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788305636.285788:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.285799:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.285816:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f49e4fd8/0x4a426866e6054352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086cc expref: 11 pid: 8437 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.285830:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305636.285835:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305636.285841:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.285861:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.285898:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305636.285945:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2397:x1875173994234368:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 207us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.285951:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 97 00010000:00010000:3.0:1788305636.286099:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286106:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286122:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286127:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286132:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286136:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305636.286139:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286153:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286162:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.286168:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013e6233f/0x4a426866e6054391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.286237:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2398:x1875173994234112:12345-192.168.202.55@tcp:1:lfs.0 Request processed in 9966us (10105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305636.286244:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788305636.288774:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.288866:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234624 00000100:00100000:2.0:1788305636.288878:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234624 00000100:00100000:2.0:1788305636.288929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:2.0:1788305636.288937:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+47:12438:x1875173994234624:12345-192.168.202.55@tcp:35:lfs.0 00000004:00010000:2.0:1788305636.288996:0:6523:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e1 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305636.289161:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788305636.289192:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788305636.289509:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788305636.289539:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.289549:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.289573:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.289605:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 51 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.289618:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 51 pid: 6521 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305636.289632:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015260672:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305636.289701:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958300 going to sleep for 11 seconds 00000100:00100000:3.0:1788305636.292766:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305636.293112:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234752 00000100:00100000:1.0:1788305636.293120:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234752 00010000:00010000:1.0:1788305636.293161:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 52 pid: 6521 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305636.293206:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 98 00000100:00100000:1.0:1788305636.293217:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:2395:x1875173994234752:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305636.293231:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305636.293237:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 52 pid: 6521 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.293247:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 52 pid: 6521 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.293302:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:1.0:1788305636.293306:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.293314:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.293319:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.293341:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305636.293381:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+52:2395:x1875173994234752:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 167us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305636.293386:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 98 00010000:00010000:2.0:1788305636.293531:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605433d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086be expref: 51 pid: 6521 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305636.293545:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6523:1875174015260672:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305636.293562:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.293568:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.293572:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788305636.293673:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788305636.293751:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788305636.293813:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015260800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305636.293872:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305636.293903:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305636.294651:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015260800 00000100:00100000:1.0:1788305636.294656:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015260800 00000100:00100000:1.0:1788305636.294704:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788305636.294710:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015260800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788305636.294775:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015260800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305636.294780:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:3.0:1788305636.294832:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788305636.295222:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015260800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788305636.295392:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788305636.295458:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015260928:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788305636.295498:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305636.295517:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305636.297332:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015260928 00000100:00100000:1.0:1788305636.297346:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015260928 00000100:00100000:1.0:1788305636.297415:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788305636.297425:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1875174015260928:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788305636.297623:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6523:x1875174015260928:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 188us (2112us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788305636.297649:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788305636.297962:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6523:1875174015260928:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788305636.298029:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788305636.298072:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298082:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298089:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298096:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305636.298101:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298108:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298126:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305636.298129:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788305636.298135:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.298168:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054398 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305636.298298:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788305636.298366:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788305636.298377:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 466389101070ns, next at 467389098709ns, rc = 0 00000001:00080000:3.0:1788305636.298383:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788305636.298406:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305636.298408:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788305636.298415:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054383 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e1 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.298509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:12438:x1875173994234624:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 9571us (9741us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788305636.298518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000020:00080000:3.0:1788305636.298522:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788305636.303028:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.303120:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994234880 00000100:00100000:0.0:1788305636.303132:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994234880 00000100:00100000:0.0:1788305636.303198:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:0.0:1788305636.303209:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+54:12438:x1875173994234880:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305636.303233:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305636.303258:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e605439f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086e8 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.303551:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e605439f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e8 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.303565:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e605439f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e8 expref: 55 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.303585:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.303588:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305636.303593:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9000, rc 0) 00000100:00100000:0.0:1788305636.303744:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:12438:x1875173994234880:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 536us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.303751:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 219 00000100:00100000:1.0:1788305636.308262:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.308446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994235136 00000100:00100000:3.0:1788305636.308456:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994235136 00000100:00100000:3.0:1788305636.308511:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:3.0:1788305636.308522:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+55:12438:x1875173994235136:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305636.308752:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12438:x1875173994235136:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 231us (498us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788305636.308760:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00010000:00010000:3.0:1788305636.437468:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305636.440005:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.440079:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994235264 00000100:00100000:0.0:1788305636.440088:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994235264 00000100:00100000:0.0:1788305636.440142:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 220 00000100:00100000:0.0:1788305636.440153:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12448:x1875173994235264:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:0.0:1788305636.440236:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440253:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440262:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440269:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440327:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440344:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440405:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440410:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440414:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788305636.440454:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440463:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440467:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440472:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440476:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.440479:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440483:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440497:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305636.440499:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305636.440502:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440506:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e60543a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440516:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440519:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440522:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440526:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.440528:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440531:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440534:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:0.0:1788305636.440535:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305636.440537:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440540:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e60543ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440552:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440555:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440559:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440562:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.440563:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440568:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440575:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.440577:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305636.440579:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.440585:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305636.440667:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12448:x1875173994235264:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 515us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.440675:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 220 00000100:00100000:0.0:1788305636.480547:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305636.480665:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994235520 00000100:00100000:1.0:1788305636.480677:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994235520 00000100:00100000:1.0:1788305636.480775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:1.0:1788305636.480787:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+56:12452:x1875173994235520:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305636.480810:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305636.480845:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60543bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481008:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481024:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481046:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481053:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481059:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481406:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60543d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481434:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60543d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481442:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60543d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305636.481453:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788305636.481534:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481542:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481549:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481554:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305636.481558:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481566:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481579:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305636.481582:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305636.481587:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481593:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51a00/0x4a426866e60543c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481606:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481618:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481624:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481629:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305636.481632:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481638:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481647:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:1.0:1788305636.481650:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305636.481653:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481658:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e60543c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481702:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50e00/0x4a426866e60543bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086ef expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481716:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60543d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086ef expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.481724:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305636.481727:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305636.481735:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:1.0:1788305636.481811:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12452:x1875173994235520:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1026us (1273us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788305636.481820:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 221 00000100:00100000:2.0:1788305636.488261:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.488538:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994235648 00000100:00100000:0.0:1788305636.488549:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994235648 00000100:00100000:0.0:1788305636.488618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 222 00000100:00100000:0.0:1788305636.488629:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12452:x1875173994235648:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305636.488695:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488712:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488724:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488759:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488766:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488773:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488779:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.488784:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488791:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488802:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.488805:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305636.488810:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.488838:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8c00/0x4a426866e60543de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305636.489127:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12452:x1875173994235648:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 498us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.489135:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 222 00000100:00100000:2.0:1788305636.494785:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.495020:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994235904 00000100:00100000:3.0:1788305636.495045:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994235904 00000100:00100000:3.0:1788305636.495141:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:3.0:1788305636.495152:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+58:12452:x1875173994235904:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305636.495441:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:12452:x1875173994235904:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 290us (667us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788305636.495449:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305636.602409:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.602498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994236160 00000100:00100000:3.0:1788305636.602510:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994236160 00000100:00100000:3.0:1788305636.602577:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:3.0:1788305636.602588:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+59:12462:x1875173994236160:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305636.602615:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305636.602619:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788305636.602646:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054360 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086d3 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602665:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305636.602670:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305636.602683:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60543e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086f6 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602787:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60543ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602801:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60543ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602810:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60543ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305636.602864:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788305636.602969:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e60543e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086f6 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602985:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60543ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086f6 expref: 60 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.602993:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.602996:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305636.602999:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305636.603064:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12462:x1875173994236160:12345-192.168.202.55@tcp:101:bash.0 Request processed in 478us (666us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788305636.603072:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 223 00000100:00100000:1.0:1788305636.606458:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.606540:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994236288 00000100:00100000:3.0:1788305636.606549:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994236288 00000100:00100000:3.0:1788305636.606612:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00100000:3.0:1788305636.606623:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12462:x1875173994236288:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305636.606648:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305636.606668:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60543fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe086fd expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.606705:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.606719:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.606748:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.606996:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60543fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 62 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.607015:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 61 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.607025:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.607028:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305636.607032:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519400, rc 0) 00000100:00100000:3.0:1788305636.607098:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:12462:x1875173994236288:12345-192.168.202.55@tcp:101:bash.0 Request processed in 476us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305636.607105:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 224 00000100:00100000:2.0:1788305636.610004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305636.610099:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994236416 00000100:00100000:1.0:1788305636.610108:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994236416 00000100:00100000:1.0:1788305636.610174:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:1.0:1788305636.610185:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+61:2397:x1875173994236416:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305636.610199:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305636.610223:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60543ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086f6 expref: 61 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305636.610240:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305636.610245:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305636.610320:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:2397:x1875173994236416:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 137us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305636.610328:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305636.612469:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.612552:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994236672 00000100:00100000:3.0:1788305636.612561:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994236672 00000100:00100000:3.0:1788305636.612616:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 225 00000100:00100000:3.0:1788305636.612625:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+60:12462:x1875173994236672:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:3.0:1788305636.612678:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305636.612703:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e60543d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086ef expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.612720:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.612725:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305636.612922:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.612952:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.612962:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305636.613007:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788305636.613029:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007da5650d reply state 000000009e35ceeb transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.613041:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.613047:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.613050:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305636.613053:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305636.613138:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12462:x1875173994236672:12345-192.168.202.55@tcp:36:bash.0 Request processed in 513us (676us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788305636.613159:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 225 00000020:00080000:3.0:1788305636.613164:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788305636.619375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.619489:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994236800 00000100:00100000:0.0:1788305636.619500:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994236800 00000100:00100000:0.0:1788305636.619560:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 226 00000100:00100000:0.0:1788305636.619572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+62:12462:x1875173994236800:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305636.619599:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305636.619620:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605440f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08704 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619731:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619743:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305636.619771:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788305636.619774:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305636.619792:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619933:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605440f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619953:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.619963:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.619967:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305636.619971:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8a00, rc 0) 00000100:00100000:0.0:1788305636.620036:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12462:x1875173994236800:12345-192.168.202.55@tcp:101:bash.0 Request processed in 465us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.620042:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 226 00000100:00100000:2.0:1788305636.623518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.623777:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237056 00000100:00100000:3.0:1788305636.623787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237056 00000100:00100000:3.0:1788305636.623834:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788305636.623844:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+63:12462:x1875173994237056:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:3.0:1788305636.624149:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12462:x1875173994237056:12345-192.168.202.55@tcp:35:bash.0 Request processed in 306us (639us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788305636.624158:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:1.0:1788305636.708244:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.708393:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237184 00000100:00100000:3.0:1788305636.708416:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237184 00000100:00100000:3.0:1788305636.708479:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:3.0:1788305636.708491:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+64:12468:x1875173994237184:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305636.708519:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305636.708541:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605441d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0870b expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708618:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708632:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708643:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305636.708686:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788305636.708689:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305636.708709:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708734:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605441d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0870b expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708752:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0870b expref: 65 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.708760:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305636.708763:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305636.708767:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305636.708839:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994237184:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 349us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305636.708846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 227 00000100:00100000:2.0:1788305636.714125:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.714195:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237312 00000100:00100000:0.0:1788305636.714206:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237312 00000100:00100000:0.0:1788305636.714269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 228 00000100:00100000:0.0:1788305636.714304:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994237312:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305636.714338:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305636.714361:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e605442b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08712 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714428:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714443:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714454:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714480:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714488:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714496:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714567:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714577:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714585:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305636.714639:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788305636.714643:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305636.714663:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714674:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714683:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714689:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714705:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714711:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.714716:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714723:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714735:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305636.714738:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305636.714741:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714748:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9800/0x4a426866e6054432 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714760:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714765:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714771:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714776:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305636.714780:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714791:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714798:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:0.0:1788305636.714799:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305636.714802:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714806:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e6054439 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714829:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e605442b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714842:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.714859:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.714861:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305636.714863:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9400, rc 0) 00000100:00100000:0.0:1788305636.714928:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12468:x1875173994237312:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 626us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.714935:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 228 00000100:00100000:0.0:1788305636.721507:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.721594:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237568 00000100:00100000:3.0:1788305636.721604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237568 00000100:00100000:3.0:1788305636.721669:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:3.0:1788305636.721680:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12468:x1875173994237568:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305636.721700:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305636.721720:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054447 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08719 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721827:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721842:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721862:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721870:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721908:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.721921:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.721959:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015261056:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305636.722072:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.722081:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.722090:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015261184:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305636.722113:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666540 going to sleep for 11 seconds 00000100:00100000:1.0:1788305636.726363:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.726577:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237696 00000100:00100000:3.0:1788305636.726589:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237696 00010000:00010000:3.0:1788305636.726640:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 68 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.726685:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 99 00000100:00100000:3.0:1788305636.726695:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:2398:x1875173994237696:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305636.726710:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305636.726717:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 68 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.726731:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 68 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.726754:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.726759:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.726781:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.726787:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305636.726856:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:2398:x1875173994237696:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 151us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305636.726864:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 99 00010000:00010000:3.0:1788305636.731271:0:6521:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.55@tcp) returned -22 from blocking AST (req@00000000d4a2a39c x1875174015261056) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.731350:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e6054440 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08712 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305636.731370:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015261056:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305636.731386:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015261184:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305636.731411:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.731417:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.731428:0:6521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.731436:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305636.733521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.733629:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994237824 00000100:00100000:0.0:1788305636.733640:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994237824 00010000:00010000:0.0:1788305636.733680:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305636.733743:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 100 00000100:00100000:0.0:1788305636.733753:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:2395:x1875173994237824:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305636.733768:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305636.733774:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733786:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733807:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e6054416 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08704 expref: 67 pid: 6519 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733823:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.733828:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733838:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733845:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.733884:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305636.733935:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:2395:x1875173994237824:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 183us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.733942:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 100 00010000:00010000:3.0:1788305636.734127:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.734143:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305636.734161:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788305636.734320:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054447 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.734347:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.734355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.734358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305636.734361:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519c00, rc 0) 00000100:00100000:3.0:1788305636.734389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12468:x1875173994237568:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 12712us (12893us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788305636.734396:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 229 00000100:00100000:2.0:1788305636.742093:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.742448:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238080 00000100:00100000:0.0:1788305636.742473:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238080 00000100:00100000:0.0:1788305636.742538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788305636.742547:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12468:x1875173994238080:12345-192.168.202.55@tcp:103:lfs.0 00010000:00010000:0.0:1788305636.742563:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305636.742589:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e605439f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086e8 expref: 66 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.742617:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305636.742623:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305636.742674:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994238080:12345-192.168.202.55@tcp:103:lfs.0 Request processed in 128us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.742681:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:1.0:1788305636.746447:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305636.746603:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238208 00000100:00100000:0.0:1788305636.746623:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238208 00000100:00100000:0.0:1788305636.746684:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 230 00000100:00100000:0.0:1788305636.746694:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994238208:12345-192.168.202.55@tcp:58:lfs.0 00010000:00010000:0.0:1788305636.746832:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.746859:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305636.746872:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305636.746981:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788305636.747886:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994238208:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 633us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305636.747897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 230 00000100:00100000:1.0:1788305636.750373:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.750516:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238336 00000100:00100000:2.0:1788305636.750526:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238336 00000100:00100000:2.0:1788305636.750587:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 231 00000100:00100000:2.0:1788305636.750598:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+65:12468:x1875173994238336:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305636.750630:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305636.750652:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08720 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750718:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750731:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750763:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750778:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750791:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:2.0:1788305636.750794:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305636.750797:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.750805:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20200, rc 0) 00000100:00100000:2.0:1788305636.750870:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12468:x1875173994238336:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 273us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305636.750877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 231 00000001:00080000:3.0:1788305636.825103:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788305636.825115:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:0.0:1788305636.951479:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305636.951490:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305636.951517:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788305636.951528:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305636.952063:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015261312:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305636.952249:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa149c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305636.958370:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015261312:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305636.972242:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.972554:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238464 00000100:00100000:3.0:1788305636.972564:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238464 00000100:00100000:3.0:1788305636.972631:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:3.0:1788305636.972642:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12469:x1875173994238464:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788305636.972677:0:10615:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788305636.972795:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12469:x1875173994238464:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 154us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305636.972804:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 232 00000100:00100000:1.0:1788305636.979147:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.979245:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238592 00000100:00100000:2.0:1788305636.979255:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238592 00000100:00100000:2.0:1788305636.979353:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:2.0:1788305636.979364:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12469:x1875173994238592:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788305636.979438:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979455:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979469:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979503:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979511:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979518:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979539:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979548:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979555:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305636.979600:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788305636.979604:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305636.979631:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979642:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979648:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979655:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979670:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305636.979674:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979682:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979694:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:2.0:1788305636.979697:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305636.979702:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979708:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e605446a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979721:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979727:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979733:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979738:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305636.979741:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979746:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979765:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff88908362e300) 00010000:00010000:2.0:1788305636.979768:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305636.979771:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979776:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20600/0x4a426866e6054471 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979790:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979796:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979801:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979806:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305636.979809:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979815:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.979822:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:2.0:1788305636.979824:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305636.980220:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305636.980228:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21a00/0x4a426866e6054478 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305636.980349:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12469:x1875173994238592:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 985us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305636.980357:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 233 00000100:00100000:2.0:1788305636.988868:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305636.989083:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238848 00000100:00100000:3.0:1788305636.989094:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238848 00000100:00100000:3.0:1788305636.989167:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:3.0:1788305636.989179:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+66:12469:x1875173994238848:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305636.989211:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305636.989231:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605447f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08727 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992246:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992287:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992302:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305636.992381:0:10615:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788305636.992483:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992491:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992498:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992504:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305636.992509:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992516:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992542:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:3.0:1788305636.992545:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305636.992550:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992556:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e6054486 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992609:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605447f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08727 expref: 68 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992620:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:3.0:1788305636.992623:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305636.992626:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e605447f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08727 expref: 68 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305636.992636:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305636.992718:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994238848:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3540us (3860us total) trans 4294967505 rc 301/301 00000100:00100000:3.0:1788305636.992728:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 234 00000100:00100000:0.0:1788305636.996601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305636.996711:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994238976 00000100:00100000:2.0:1788305636.996722:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994238976 00000100:00100000:2.0:1788305636.996784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 235 00000100:00100000:2.0:1788305636.996795:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994238976:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305636.996860:0:6520:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305636.997083:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994238976:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 289us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305636.997091:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 235 00000100:00100000:1.0:1788305637.004074:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.005732:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994239232 00000100:00100000:0.0:1788305637.005748:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994239232 00000100:00100000:0.0:1788305637.005830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 236 00000100:00100000:0.0:1788305637.005841:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994239232:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305637.005870:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305637.005874:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788305637.005913:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e6054424 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0870b expref: 67 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.005936:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:0.0:1788305637.005942:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305637.005956:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054494 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0872e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305637.007497:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788305637.008904:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e605449b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.008926:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e605449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.008951:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e605449b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.009017:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054494 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0872e expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.009036:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e605449b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0872e expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.009044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889186383d00) 00010000:00010000:0.0:1788305637.009047:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305637.009050:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8600, rc 0) 00000100:00100000:0.0:1788305637.009190:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12469:x1875173994239232:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 3350us (5124us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788305637.009198:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 236 00000100:00100000:1.0:1788305637.024216:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.024453:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994239488 00000100:00100000:3.0:1788305637.024465:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994239488 00000100:00100000:3.0:1788305637.024530:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 237 00000100:00100000:3.0:1788305637.024541:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12469:x1875173994239488:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.024615:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305637.024644:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8600/0x4a426866e605449b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0872e expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024677:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff889186383d00) 00010000:00010000:3.0:1788305637.024687:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305637.024709:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024721:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024729:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024743:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024749:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024755:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024804:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024810:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024816:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024822:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523be00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305637.024826:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024841:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024862:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:3.0:1788305637.024865:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305637.024868:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024874:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024884:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024889:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024894:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024899:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305637.024912:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024918:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024925:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x747f4b1d (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.024927:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305637.024929:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.024943:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x747f4b1d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.025023:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994239488:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 483us (817us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305637.025030:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 237 00000100:00100000:1.0:1788305637.039591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.039756:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994239616 00000100:00100000:3.0:1788305637.039766:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994239616 00000100:00100000:3.0:1788305637.039836:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 238 00000100:00100000:3.0:1788305637.039855:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+67:12469:x1875173994239616:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.039876:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305637.039912:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08735 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.039953:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.039967:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.039979:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.040102:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 69 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.040122:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 68 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.040145:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.040149:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305637.040153:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523be00, rc 0) 00000100:00100000:3.0:1788305637.040229:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12469:x1875173994239616:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 383us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.040237:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 238 00000100:00100000:0.0:1788305637.046012:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.046117:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994239872 00000100:00100000:3.0:1788305637.046126:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994239872 00000100:00100000:3.0:1788305637.046179:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 239 00000100:00100000:3.0:1788305637.046187:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+68:12469:x1875173994239872:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.046259:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.046287:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.046297:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305637.046448:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788305637.046455:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 467137179021ns, next at 468137177154ns, rc = 0 00000004:00010000:3.0:1788305637.046492:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9b9e584 reply state 000000003070ac8d transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.046502:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.046507:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.046520:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788305637.046523:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305637.046638:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12469:x1875173994239872:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 450us (633us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788305637.046645:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 239 00000100:00100000:1.0:1788305637.052701:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.053260:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240000 00000100:00100000:3.0:1788305637.053269:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240000 00000100:00100000:3.0:1788305637.053339:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 240 00000100:00100000:3.0:1788305637.053349:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+70:12469:x1875173994240000:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.053374:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305637.053396:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0873c expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.053455:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 71 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.053467:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 71 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.053482:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.053484:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305637.053486:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305637.053540:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+71:12469:x1875173994240000:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 194us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.053545:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 240 00000100:00100000:0.0:1788305637.059920:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.060075:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240128 00000100:00100000:3.0:1788305637.060086:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240128 00000100:00100000:3.0:1788305637.060210:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:3.0:1788305637.060235:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2395:x1875173994240128:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788305637.060525:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2395:x1875173994240128:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 291us (625us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788305637.060534:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:1.0:1788305637.063729:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.063852:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240384 00000100:00100000:3.0:1788305637.063861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240384 00000100:00100000:3.0:1788305637.063923:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:3.0:1788305637.063934:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+71:12469:x1875173994240384:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305637.064165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+72:12469:x1875173994240384:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 232us (445us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788305637.064174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:1.0:1788305637.068959:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.069509:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240640 00000100:00100000:3.0:1788305637.069520:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240640 00000100:00100000:3.0:1788305637.069582:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 241 00000100:00100000:3.0:1788305637.069591:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+72:12469:x1875173994240640:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305637.069712:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+72:12469:x1875173994240640:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 121us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.069719:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 241 00000100:00080000:0.0:1788305637.070657:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305637.073782:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.074154:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240768 00000100:00100000:3.0:1788305637.074165:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240768 00000100:00100000:3.0:1788305637.074230:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 242 00000100:00100000:3.0:1788305637.074242:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+72:12469:x1875173994240768:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.074262:0:10615:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305637.074334:0:10615:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544d3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08743 expref: -99 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074419:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074450:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074463:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305637.074510:0:10615:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305637.074529:0:10615:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074567:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544d3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08743 expref: 74 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074587:0:10615:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08743 expref: 73 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.074596:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.074599:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305637.074602:0:10615:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565200, rc 0) 00000100:00100000:2.0:1788305637.078260:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+73:12469:x1875173994240768:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 4006us (4473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.078273:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 242 00000100:00100000:2.0:1788305637.085727:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.086151:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994240896 00000100:00100000:0.0:1788305637.086161:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994240896 00000100:00100000:0.0:1788305637.086222:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:0.0:1788305637.086234:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+10:2397:x1875173994240896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305637.086252:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305637.086308:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0874a expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788305637.086345:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9760e4, blocks: 0x0 00010000:00010000:0.0:1788305637.086389:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=467s v=(0 0) 00010000:00010000:0.0:1788305637.086394:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305637.086406:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 11 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.086425:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 11 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.086439:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305637.086505:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2397:x1875173994240896:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 273us (789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.086512:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:1.0:1788305637.095952:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.096146:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241152 00000100:00100000:3.0:1788305637.096156:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241152 00000100:00100000:3.0:1788305637.096217:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 243 00000100:00100000:3.0:1788305637.096228:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+73:12469:x1875173994241152:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305637.096389:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+73:12469:x1875173994241152:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 162us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.096396:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 243 00000100:00100000:1.0:1788305637.104398:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.104566:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241280 00000100:00100000:2.0:1788305637.104577:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241280 00000100:00100000:2.0:1788305637.104748:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:2.0:1788305637.104759:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:12469:x1875173994241280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788305637.104777:0:8437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305637.104806:0:8437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08751 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.104861:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 12 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.104871:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305637.104875:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305637.104880:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.104914:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 12 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.104928:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 12 pid: 8758 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.104941:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015261440:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305637.108788:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.111963:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.112809:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241408 00000100:00100000:3.0:1788305637.112858:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241408 00010000:00010000:3.0:1788305637.112905:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 13 pid: 8758 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.112955:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:3.0:1788305637.112966:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2396:x1875173994241408:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305637.112983:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305637.113017:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 13 pid: 8758 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.113034:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 13 pid: 8758 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.113063:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305637.113068:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305637.113077:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.113088:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.113130:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 13 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.113161:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1875174015261568:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305637.116598:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae17ee94/0x4a426866e60544e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0874a expref: 13 pid: 8758 timeout: 567 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.116634:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8437:1875174015261440:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305637.116665:0:8437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 12 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.116681:0:8437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21600, rc 0) 00000100:00100000:0.0:1788305637.116759:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+12:12469:x1875173994241280:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 12001us (12370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.116767:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:2.0:1788305637.123836:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305637.124125:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.124378:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6505:1875174015261568:192.168.202.55@tcp:105: 00010000:00010000:2.0:1788305637.124402:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305637.124463:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2396:x1875173994241408:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 11498us (12510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.124475:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:0.0:1788305637.124597:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241536 00000100:00100000:0.0:1788305637.124613:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241536 00002000:00100000:0.0:1788305637.124666:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8891bb3a8a80 x1875173994241536/t0(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:568/0 lens 504/0 e 0 to 0 dl 1788305648 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305637.124677:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bb3a8a80 with x1875173994241536 ext(0->12) 00002000:00010000:0.0:1788305637.124682:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bb3a8a80 00000100:00100000:0.0:1788305637.124703:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305637.124713:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+11:2396:x1875173994241536:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788305637.126389:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2396:x1875173994241536:12345-192.168.202.55@tcp:4:lhsmtool_posix.0 Request processed in 1669us (2261us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788305637.126399:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00002000:00100000:0.0:1788305637.126407:0:8442:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8891bb3a8a80 x1875173994241536/t4294967321(0) o4->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:568/0 lens 504/448 e 0 to 0 dl 1788305648 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305637.126417:0:8442:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8891bb3a8a80 with x1875173994241536 ext(0->12) 00002000:00010000:0.0:1788305637.126422:0:8442:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8891bb3a8a80 00000100:00100000:1.0:1788305637.131664:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.131919:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241664 00000100:00100000:0.0:1788305637.131931:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241664 00000100:00100000:0.0:1788305637.131994:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 244 00000100:00100000:0.0:1788305637.132004:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+73:12469:x1875173994241664:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788305637.136483:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788305637.136511:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1788305637.136543:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788305637.136570:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff88918664de40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788305637.136576:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2a2600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff88918664d0c0 00000020:00080000:3.0:1788305637.136579:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891bb2a2000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889083ede200 00000004:00080000:3.0:1788305637.136601:0:6498:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00010000:00010000:0.0:1788305637.136698:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136711:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136719:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136736:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.136741:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136747:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136764:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8891885c8a00) 00010000:00010000:0.0:1788305637.136767:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.136771:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136776:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518600/0x4a426866e60541ed lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136807:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136813:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136901:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136907:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.136910:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136917:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136936:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8890825b7400) 00010000:00010000:0.0:1788305637.136939:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.136943:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136947:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e6054295 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136965:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136970:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136975:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136979:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.136982:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136987:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.136994:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:0.0:1788305637.136996:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.136999:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137004:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054313 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137468:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137474:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137480:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137485:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.137488:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137493:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137502:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c7b0300) 00010000:00010000:0.0:1788305637.137504:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.137507:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137511:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b800/0x4a426866e6054336 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137525:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137531:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137535:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137547:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.137550:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137555:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137562:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.137564:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.137567:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137573:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054408 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137584:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137590:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137596:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.137601:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ae00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.137604:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.137808:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305637.138023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015261696:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788305637.138105:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8891bb30f900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788305637.138109:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891b8f2d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8891bb30fcc0 00000020:00080000:3.0:1788305637.138112:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8891b8f2d900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889182a77600 00000020:00080000:3.0:1788305637.138128:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788305637.138147:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788305637.138215:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:0.0:1788305637.138594:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.138630:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:0.0:1788305637.138633:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788305637.138636:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.138641:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ae00/0x4a426866e60544c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.138667:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015261952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788305637.138735:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305637.138925:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12469:x1875173994241664:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 6920us (7268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.138946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 244 00000100:00100000:3.0:1788305637.139740:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015261952 00000100:00100000:3.0:1788305637.139750:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015261952 00000100:00100000:3.0:1788305637.139803:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788305637.139813:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015261952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788305637.139857:0:8758:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788305637.139887:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9760e3, atime: 0x6a9760e3, ctime: 0x6a9760e3, blocks: 0x8 00010000:00010000:3.0:1788305637.139894:0:8758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.139909:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=467s v=(0 0) 00010000:00010000:3.0:1788305637.139914:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305637.139921:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.139935:0:8758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.139955:0:8758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.139964:0:8758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.139983:0:8758:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305637.140156:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015261952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 344us (1421us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788305637.140163:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:3.0:1788305637.140183:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305637.140189:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.140197:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305637.140201:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.140209:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.140222:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.140229:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de6e627/0x4a426866e60544ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.140252:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305637.140254:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305637.140255:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305637.140310:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788305637.140315:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:3.0:1788305637.140347:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff88918caaa300, transno 4294967308 00000004:00080000:3.0:1788305637.140358:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:3.0:1788305637.140373:0:3650:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff889184027100 x1875174015261952/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788305653 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788305637.140385:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff889184027100/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788305637.140390:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015261952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788305637.144314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.144530:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994241792 00000100:00100000:3.0:1788305637.144540:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994241792 00000100:00100000:3.0:1788305637.144598:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:3.0:1788305637.144711:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+13:2398:x1875173994241792:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788305637.144942:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015261824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788305637.145001:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305637.145045:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015261824 00000100:00100000:1.0:1788305637.145049:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015261824 00000100:00100000:1.0:1788305637.145087:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305637.145093:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015261824:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788305637.145225:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305637.147638:0:8437:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788305637.147654:0:8437:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1788305637.147767:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015261696 00000100:00100000:0.0:1788305637.147777:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015261696 00000100:00100000:0.0:1788305637.147908:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305637.147917:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015261696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788305637.147947:0:14680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788305637.147973:0:14680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.147997:0:14680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 13 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.149654:0:14680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788305637.149660:0:14680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305637.149665:0:14680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.149713:0:14680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 13 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.149730:0:14680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 13 pid: 8758 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.149747:0:14680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14680:1875174015262080:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305637.149887:0:14680:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788305637.149939:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1788305637.153414:0:8758:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788305637.153424:0:8758:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788305636 00002000:00010000:1.0:1788305637.153426:0:8758:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788305637.153428:0:8758:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788305636 -> 1788305636 00002000:00010000:1.0:1788305637.153430:0:8758:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788305637.153520:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3649:x1875174015261824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 8422us (8514us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788305637.153530:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:3.0:1788305637.154067:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891903d4700/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788305637.154074:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015261824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788305637.154952:0:14680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:14680:1875174015262080:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305637.154977:0:14680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305637.156748:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1788305637.156768:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:3.0:1788305637.157381:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2398:x1875173994241792:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 12765us (13098us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.157393:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:0.0:1788305637.165655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.165956:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242048 00000100:00100000:3.0:1788305637.165967:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242048 00000100:00100000:3.0:1788305637.166162:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 245 00000100:00100000:3.0:1788305637.166174:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12469:x1875173994242048:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.166245:0:6521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305637.166273:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889183565200/0x4a426866e60544da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08743 expref: 21 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.166332:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.166338:0:6521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305637.166368:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.166384:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.166395:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305637.166520:0:6521:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092820d38 reply state 0000000072f4f796 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.166534:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.166540:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.166543:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305637.166546:0:6521:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305637.166665:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:12469:x1875173994242048:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 493us (1018us total) trans 4294967509 rc 0/0 00000100:00100000:3.0:1788305637.166673:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 245 00000100:00100000:0.0:1788305637.172971:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305637.173122:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242176 00000100:00100000:1.0:1788305637.173132:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242176 00010000:00010000:1.0:1788305637.174566:0:6506:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305637.174628:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:1.0:1788305637.174640:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994242176:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788305637.174655:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305637.174661:0:6506:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.174676:0:6506:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.174701:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e29426/0x4a426866e60542a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086a9 expref: 8 pid: 8758 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.174718:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305637.174722:0:6506:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305637.174729:0:6506:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.174737:0:6506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.174785:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305637.174867:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994242176:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 229us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305637.174874:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:0.0:1788305637.175006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.175047:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242304 00000100:00100000:0.0:1788305637.175054:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242304 00000100:00100000:0.0:1788305637.175085:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 77 00000100:00100000:0.0:1788305637.175093:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994242304:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788305637.175227:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788305637.175237:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788305636 -> 1788305636 00002000:00010000:0.0:1788305637.175239:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788305635 00002000:00010000:0.0:1788305637.175241:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788305636 -> 1788305636 00002000:00010000:0.0:1788305637.175244:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788305637.175269:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994242304:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 178us (264us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788305637.175301:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 77 00010000:00010000:3.0:1788305637.176044:0:14680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.176071:0:14680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.176081:0:14680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.176087:0:14680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.176112:0:14680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305637.176352:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015261696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 28433us (31125us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788305637.176360:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788305637.176482:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305637.176490:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.176498:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305637.176502:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.176511:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.176528:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.176535:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c94dd86/0x4a426866e60544f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.176555:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305637.176557:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305637.176558:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305637.180785:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:2.0:1788305637.180796:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:2.0:1788305637.180899:0:3647:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8891903d4700 x1875174015261824/t4294967322(4294967322) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788305653 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788305637.180914:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891903d4e00/2, rc 0, transno 4294967324 00000100:00100000:2.0:1788305637.180919:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015261696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788305637.181709:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.181804:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242560 00000100:00100000:2.0:1788305637.181813:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242560 00000100:00100000:2.0:1788305637.181977:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 246 00000100:00100000:2.0:1788305637.181989:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:12469:x1875173994242560:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788305637.182065:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.182082:0:10615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.182092:0:10615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.182126:0:10615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.182141:0:10615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.182175:0:10615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015262208:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305637.182262:0:10615:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.187153:0:10615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10615:1875174015262208:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305637.187187:0:10615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305637.188755:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.189531:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242688 00000100:00100000:3.0:1788305637.189542:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242688 00010000:00010000:3.0:1788305637.189596:0:7471:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 23 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.189647:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 103 00000100:00100000:3.0:1788305637.189657:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+23:2396:x1875173994242688:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305637.189672:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305637.189679:0:7471:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 23 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189691:0:7471:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 23 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189727:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523be00/0x4a426866e60544be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08735 expref: 23 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189743:0:7471:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:3.0:1788305637.189748:0:7471:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189756:0:7471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189763:0:7471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.189795:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305637.189866:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2396:x1875173994242688:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 209us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.189873:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 103 00010000:00010000:1.0:1788305637.190526:0:10615:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190536:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190590:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190597:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190605:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190611:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305637.190615:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190623:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190635:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:1.0:1788305637.190638:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788305637.190651:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.190658:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21c00/0x4a426866e6054504 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305637.190766:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12469:x1875173994242560:12345-192.168.202.55@tcp:55:lhsmtool_posix.0 Request processed in 8777us (9059us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788305637.190778:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 246 00000100:00100000:1.0:1788305637.200204:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.200401:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242816 00000100:00100000:3.0:1788305637.200411:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242816 00000100:00100000:3.0:1788305637.200466:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:3.0:1788305637.200477:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994242816:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788305637.200522:0:8758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.200543:0:8758:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.200586:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305637.200590:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305637.200595:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.200642:0:8758:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 8 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.200657:0:8758:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 8 pid: 8437 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.200671:0:8758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8758:1875174015262336:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305637.200754:0:8758:0:(client.c:2715:ptlrpc_set_wait()) set ffff889082666f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.208375:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.208594:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994242944 00000100:00100000:0.0:1788305637.208604:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994242944 00010000:00010000:0.0:1788305637.208654:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 9 pid: 8437 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.208698:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:0.0:1788305637.208708:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+9:2396:x1875173994242944:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305637.208722:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305637.208743:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 9 pid: 8437 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.208756:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 9 pid: 8437 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.208780:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305637.208785:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788305637.208791:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.208801:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.209164:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305637.209354:0:8758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60544e8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08751 expref: 9 pid: 8437 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.209370:0:8758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8758:1875174015262336:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305637.209393:0:8758:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209402:0:8758:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209409:0:8758:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209445:0:8758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209452:0:8758:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209458:0:8758:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209464:0:8758:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305637.209468:0:8758:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209476:0:8758:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209488:0:8758:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305637.209494:0:8758:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013e6233f/0x4a426866e605450b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.209628:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994242944:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 920us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.209636:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 104 00000100:00100000:3.0:1788305637.210512:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994242816:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 10032us (10313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305637.210521:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 78 00000100:00100000:1.0:1788305637.215123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.215216:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994243200 00000100:00100000:2.0:1788305637.215225:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994243200 00000100:00100000:2.0:1788305637.215335:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 247 00000100:00100000:2.0:1788305637.215346:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:12469:x1875173994243200:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788305637.215419:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.215435:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 21 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.215446:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.215477:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 21 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.215490:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 21 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.215521:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262464:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305637.215801:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305637.220794:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.221262:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994243328 00000100:00100000:0.0:1788305637.221272:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994243328 00010000:00010000:0.0:1788305637.221345:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.221389:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:0.0:1788305637.221400:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2395:x1875173994243328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305637.221415:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305637.221423:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221438:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221459:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.221465:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221474:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221481:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221488:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.221506:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305637.222518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054401 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe086fd expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.222539:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262464:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305637.222559:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222569:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222574:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222754:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222766:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222775:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222806:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.222952:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.222981:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262592:192.168.202.55@tcp:104: 00000100:00100000:0.0:1788305637.223184:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2395:x1875173994243328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 1784us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.223203:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 105 00000100:00100000:2.0:1788305637.223676:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff889183958240 going to sleep for 11 seconds 00000100:00100000:1.0:1788305637.226810:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.226829:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262592:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305637.226867:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.227266:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994243456 00000100:00100000:2.0:1788305637.227299:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994243456 00010000:00010000:2.0:1788305637.227338:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.227377:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 106 00000100:00100000:2.0:1788305637.227388:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2396:x1875173994243456:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305637.227403:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305637.227411:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227423:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227445:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518000/0x4a426866e60544cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0873c expref: 22 pid: 10615 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227462:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:2.0:1788305637.227467:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227487:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227492:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.227513:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305637.227538:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305637.227545:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.227559:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:2396:x1875173994243456:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 173us (760us total) trans 0 rc 0/0 00000001:00080000:1.0:1788305637.227657:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788305637.227754:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 106 00000001:00080000:1.0:1788305637.227773:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788305637.227806:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788305637.227970:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1875174015262720:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788305637.228029:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305637.228063:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.229517:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015262720 00000100:00100000:2.0:1788305637.229527:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015262720 00000100:00100000:2.0:1788305637.229565:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788305637.229575:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1875174015262720:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788305637.229696:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1875174015262720:12345-0@lo:1000:mdt00_001.0 Request processed in 122us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.229703:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788305637.229745:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1875174015262720:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788305637.230532:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1788305637.230616:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1875174015262848:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788305637.230652:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305637.230679:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.230691:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015262848 00000100:00100000:2.0:1788305637.230696:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015262848 00000100:00100000:2.0:1788305637.230733:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788305637.230741:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6520:x1875174015262848:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788305637.230951:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6520:x1875174015262848:12345-0@lo:1000:mdt00_001.0 Request processed in 210us (297us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788305637.230959:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788305637.231110:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6520:1875174015262848:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788305637.231143:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231152:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231160:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231167:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21e00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.231173:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231180:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231195:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:0.0:1788305637.231198:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305637.231202:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231207:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21e00/0x4a426866e6054519 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231244:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231248:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231252:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231255:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.231257:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231260:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231266:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.231267:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305637.231272:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231302:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231311:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.231340:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.231362:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262976:192.168.202.55@tcp:105: 00000100:00100000:0.0:1788305637.231436:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305637.234787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.234935:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994243584 00000100:00100000:2.0:1788305637.234945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994243584 00000100:00100000:2.0:1788305637.235003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788305637.235032:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12468:x1875173994243584:12345-192.168.202.55@tcp:49:lfs.0 00000100:00100000:0.0:1788305637.235108:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6520:1875174015262976:192.168.202.55@tcp:105: 00010000:00010000:0.0:1788305637.235134:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235144:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8a00/0x4a426866e605445c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.235167:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+25:12468:x1875173994243584:12345-192.168.202.55@tcp:49:lfs.0 Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.235174:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00010000:00010000:0.0:1788305637.235237:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235252:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235264:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235308:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235316:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235323:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235329:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.235333:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235347:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235361:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.235364:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305637.235367:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235373:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8400/0x4a426866e6054520 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235385:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235391:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235396:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235401:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305637.235404:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235410:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235418:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.235420:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305637.235423:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.235440:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054512 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.235589:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:12469:x1875173994243200:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 20244us (20473us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788305637.235598:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 247 00000020:00080000:0.0:1788305637.235601:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788305637.236623:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788305637.236631:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305637.237127:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788305637.237139:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305637.238505:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305637.239033:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994243840 00000100:00100000:2.0:1788305637.239044:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994243840 00000100:00100000:2.0:1788305637.239096:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:2.0:1788305637.239105:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+24:12469:x1875173994243840:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788305637.239361:0:6523:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788305637.239391:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788305637.239418:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239431:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239439:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239445:0:6523:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239450:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239454:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.239471:0:6523:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788305637.239541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12469:x1875173994243840:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 437us (1045us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788305637.239562:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000020:00080000:2.0:1788305637.239569:0:6523:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788305637.240453:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305637.240463:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.240472:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305637.240476:0:7461:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.240484:0:7461:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.240497:0:7461:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:0.0:1788305637.240500:0:7461:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788305637.240505:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.240511:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054527 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.240524:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305637.240526:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305637.240527:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305637.241195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.241393:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244096 00000100:00100000:0.0:1788305637.241412:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244096 00000100:00100000:0.0:1788305637.241499:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 248 00000100:00100000:0.0:1788305637.241509:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12468:x1875173994244096:12345-192.168.202.55@tcp:58:lfs.0 00000040:00080000:0.0:1788305637.241674:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788305637.241758:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12468:x1875173994244096:12345-192.168.202.55@tcp:58:lfs.0 Request processed in 249us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.241765:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 248 00000100:00100000:1.0:1788305637.271940:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305637.272075:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244224 00000100:00100000:3.0:1788305637.272086:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244224 00000100:00100000:3.0:1788305637.272171:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 249 00000100:00100000:3.0:1788305637.272182:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+26:12471:x1875173994244224:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305637.272206:0:6521:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305637.272237:0:6521:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605452e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08758 expref: -99 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272536:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272549:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272558:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272629:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272638:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272645:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272728:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272736:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272742:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272766:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.272789:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 27 pid: 6521 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305637.272799:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015263104:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305637.272958:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891839589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305637.275585:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.275664:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d7800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6521:1875174015263104:192.168.202.55@tcp:104: 00010000:00010000:0.0:1788305637.275689:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305637.276359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244480 00000100:00100000:3.0:1788305637.276368:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244480 00000100:00100000:3.0:1788305637.276431:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:3.0:1788305637.276441:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:6169:x1875173994244480:12345-192.168.202.55@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788305637.276701:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:6169:x1875173994244480:12345-192.168.202.55@tcp:35:ldlm_bl.0 Request processed in 260us (1124us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788305637.276714:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:1.0:1788305637.279022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305637.279115:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244608 00000100:00100000:0.0:1788305637.279123:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244608 00010000:00010000:0.0:1788305637.279165:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 29 pid: 6521 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305637.279194:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:0.0:1788305637.279201:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:2396:x1875173994244608:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305637.279213:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305637.279219:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 29 pid: 6521 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279229:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 29 pid: 6521 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279247:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e605444e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08719 expref: 29 pid: 6521 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279473:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305637.279479:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279486:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279491:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305637.279519:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305637.279563:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:2396:x1875173994244608:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 360us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305637.279580:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00010000:00010000:2.0:1788305637.279904:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.279912:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305637.279960:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788305637.279964:0:6521:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305637.279980:0:6521:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.279990:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.279996:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280001:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280005:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280010:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305637.280022:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280030:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280040:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:2.0:1788305637.280043:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305637.280046:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280052:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054535 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280063:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280070:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280074:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280078:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305637.280079:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280083:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280087:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff88918c769e00) 00010000:00010000:2.0:1788305637.280089:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305637.280095:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20c00/0x4a426866e605453c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280127:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e605452e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08758 expref: 28 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280137:0:6521:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08758 expref: 27 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305637.280141:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:2.0:1788305637.280143:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305637.280155:0:6521:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21800, rc 0) 00000100:00100000:2.0:1788305637.280185:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12471:x1875173994244224:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 8006us (8256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.280192:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 249 00010000:00010000:3.0:1788305637.465393:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305637.847216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015263232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305637.847371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305637.847518:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015263232 00000100:00100000:2.0:1788305637.847528:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015263232 00000100:00100000:2.0:1788305637.847572:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788305637.847581:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015263232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305637.847613:0:6525:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788305637.847662:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015263232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.847669:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788305637.847780:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015263360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305637.847810:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305637.847901:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015263360 00000100:00100000:2.0:1788305637.847906:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015263360 00000100:00100000:2.0:1788305637.847940:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788305637.847961:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015263360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305637.847981:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305637.848013:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015263360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305637.848019:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788305637.848096:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015263360:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305637.848196:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015263232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305638.000253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305638.000463:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244736 00000100:00100000:2.0:1788305638.000475:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244736 00000100:00100000:2.0:1788305638.000623:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 397 00000100:00100000:2.0:1788305638.000637:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994244736:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305638.000727:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994244736:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 92us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305638.000736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 397 00000100:00100000:1.0:1788305638.014193:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014253:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014287:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014306:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014322:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014350:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.014381:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244864 00000100:00100000:1.0:1788305638.014390:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244864 00000100:00100000:1.0:1788305638.014446:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245376 00000100:00100000:1.0:1788305638.014448:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245376 00000100:00100000:1.0:1788305638.014459:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994244992 00000100:00100000:1.0:1788305638.014461:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994244992 00000100:00100000:1.0:1788305638.014470:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245504 00000100:00100000:1.0:1788305638.014472:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245504 00000100:00100000:1.0:1788305638.014486:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 358 00000100:00100000:1.0:1788305638.014494:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:2396:x1875173994244864:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014568:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:2396:x1875173994244864:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014576:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 358 00000100:00100000:1.0:1788305638.014595:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 359 00000100:00100000:1.0:1788305638.014602:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994245376:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014627:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994245376:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014634:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 359 00000100:00100000:1.0:1788305638.014655:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 360 00000100:00100000:1.0:1788305638.014662:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994244992:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014689:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994244992:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014695:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 360 00000100:00100000:1.0:1788305638.014706:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 361 00000100:00100000:1.0:1788305638.014711:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994245504:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014733:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2396:x1875173994245504:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014739:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 361 00000100:00100000:1.0:1788305638.014756:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245120 00000100:00100000:1.0:1788305638.014759:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245120 00000100:00100000:1.0:1788305638.014780:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245248 00000100:00100000:1.0:1788305638.014782:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245248 00000100:00100000:1.0:1788305638.014799:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:1.0:1788305638.014805:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994245120:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014826:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2396:x1875173994245120:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 21us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014831:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 101 00000100:00100000:1.0:1788305638.014854:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00100000:1.0:1788305638.014860:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994245248:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305638.014878:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2396:x1875173994245248:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 19us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305638.014884:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 102 00000100:00080000:1.0:1788305638.014916:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305638.014921:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305638.014923:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788305638.037985:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788305638.152605:0:14718:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305638.152614:0:14718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305638.152647:0:14718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788305638.152654:0:14718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788305638.299549:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788305638.299557:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305638.299585:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788305638.299593:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305638.299741:0:13804:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015263488:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305638.299848:0:13804:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb30f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305638.314798:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305638.315440:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245632 00000100:00100000:0.0:1788305638.315451:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245632 00000100:00100000:0.0:1788305638.315518:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 250 00000100:00100000:0.0:1788305638.315530:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:12484:x1875173994245632:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788305638.315577:0:10615:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788305638.315804:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:12484:x1875173994245632:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 275us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305638.315812:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 250 00000100:00100000:3.0:1788305638.317046:0:13804:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13804:1875174015263488:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788305638.322387:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.322466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994245888 00000100:00100000:1.0:1788305638.322476:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994245888 00000100:00100000:1.0:1788305638.322531:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 251 00000100:00100000:1.0:1788305638.322541:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+27:12484:x1875173994245888:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305638.322561:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305638.322638:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605454a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0875f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305638.322763:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054551 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305638.322778:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305638.322792:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054551 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305638.322803:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788305638.322922:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51200/0x4a426866e605454a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0875f expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305638.322942:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054551 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0875f expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305638.322951:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305638.322953:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305638.322973:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50400, rc 0) 00000100:00100000:1.0:1788305638.323041:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:12484:x1875173994245888:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 500us (665us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788305638.323049:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 251 00000100:00100000:1.0:1788305638.336765:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305638.336829:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305638.336909:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994246016 00000100:00100000:0.0:1788305638.336919:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994246016 00000100:00100000:0.0:1788305638.336989:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788305638.336999:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:2396:x1875173994246016:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305638.337016:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305638.337043:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054551 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0875f expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305638.337061:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305638.337066:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305638.337128:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:2396:x1875173994246016:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 130us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305638.337136:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:2.0:1788305638.337766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994246272 00000100:00100000:2.0:1788305638.337772:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994246272 00000100:00100000:2.0:1788305638.337813:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 252 00000100:00100000:2.0:1788305638.337822:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+28:12484:x1875173994246272:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788305638.337906:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.337922:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.337933:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338092:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338116:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338123:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338129:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305638.338133:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338140:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338151:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:2.0:1788305638.338154:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305638.338158:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305638.338164:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e605455f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305638.338418:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305638.338430:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305638.338948:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788305638.338957:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788305638.339286:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:12484:x1875173994246272:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 1447us (2439us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788305638.339297:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 252 00000100:00100000:1.0:1788305638.343912:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305638.344142:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994246528 00000100:00100000:0.0:1788305638.344159:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994246528 00000100:00100000:0.0:1788305638.344257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:0.0:1788305638.344269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+29:12484:x1875173994246528:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788305638.344538:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:12484:x1875173994246528:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 271us (638us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788305638.344546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00010000:00010000:0.0:1788305638.495801:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305639.509846:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305640.063092:0:14769:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305640.063102:0:14769:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305640.063124:0:14769:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788305640.063130:0:14769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788305640.258645:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305640.258746:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994246784 00000100:00100000:0.0:1788305640.258757:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994246784 00000100:00100000:0.0:1788305640.258870:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 253 00000100:00100000:0.0:1788305640.258882:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+30:12504:x1875173994246784:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:0.0:1788305640.258907:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305640.258928:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054566 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08766 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.259036:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e605456d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.259052:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e605456d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.259065:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e605456d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305640.259077:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788305640.259179:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054566 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08766 expref: 33 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.259197:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e605456d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08766 expref: 32 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.259205:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305640.259207:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788305640.259209:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9400, rc 0) 00000100:00100000:0.0:1788305640.259260:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:12504:x1875173994246784:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 383us (628us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788305640.259306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 253 00000100:00080000:1.0:1788305640.259401:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305640.264057:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305640.264143:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994246912 00000100:00100000:0.0:1788305640.264153:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994246912 00000100:00100000:0.0:1788305640.264217:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 254 00000100:00100000:0.0:1788305640.264228:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:12504:x1875173994246912:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:0.0:1788305640.264439:0:10615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264458:0:10615:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264472:0:10615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264509:0:10615:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264516:0:10615:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264524:0:10615:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264530:0:10615:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305640.264534:0:10615:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264541:0:10615:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264552:0:10615:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:0.0:1788305640.264569:0:10615:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788305640.264574:0:10615:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305640.264581:0:10615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8000/0x4a426866e605457b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10615 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305640.264697:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+32:12504:x1875173994246912:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 470us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305640.264705:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 254 00000100:00100000:2.0:1788305640.361431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305640.361527:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247040 00000100:00100000:3.0:1788305640.361537:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247040 00000100:00100000:3.0:1788305640.361633:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00100000:3.0:1788305640.361644:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994247040:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:3.0:1788305640.361663:0:8758:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305640.361683:0:8758:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009bd0729f/0x4a426866e6054582 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0876d expref: -99 pid: 8758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305640.361711:0:8758:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9760e4, atime: 0x6a9760e3, ctime: 0x6a9760e4, blocks: 0x8 00010000:00010000:3.0:1788305640.361730:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=470s v=(0 0) 00010000:00010000:3.0:1788305640.361736:0:8758:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305640.361745:0:8758:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009bd0729f/0x4a426866e6054582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0876d expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305640.361764:0:8758:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009bd0729f/0x4a426866e6054582 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0876d expref: 8 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305640.361777:0:8758:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305640.361939:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2395:x1875173994247040:12345-192.168.202.55@tcp:101:cat.0 Request processed in 296us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305640.361963:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 79 00000100:00080000:1.0:1788305640.362745:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305640.366456:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305640.369071:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247168 00000100:00100000:0.0:1788305640.369087:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247168 00002000:00100000:0.0:1788305640.369151:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff889184db4380 x1875173994247168/t0(0) o3->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:571/0 lens 488/0 e 0 to 0 dl 1788305651 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305640.369162:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db4380 with x1875173994247168 ext(0->4095) 00002000:00010000:0.0:1788305640.369168:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889184db4380 00000100:00100000:0.0:1788305640.369305:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305640.369316:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994247168:12345-192.168.202.55@tcp:3:cat.0 00000100:00100000:0.0:1788305640.369542:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+8:2396:x1875173994247168:12345-192.168.202.55@tcp:3:cat.0 Request processed in 226us (3094us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788305640.369550:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00002000:00100000:0.0:1788305640.369556:0:8441:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff889184db4380 x1875173994247168/t0(0) o3->52cc16d6-1587-44f4-a8e9-dfc0ecdc0891@192.168.202.55@tcp:571/0 lens 488/4536 e 0 to 0 dl 1788305651 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788305640.369564:0:8441:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184db4380 with x1875173994247168 ext(0->4095) 00002000:00010000:0.0:1788305640.369567:0:8441:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff889184db4380 00010000:00010000:3.0:1788305640.533674:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305640.919104:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305640.919130:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015263872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305640.919520:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015264384:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919649:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015264896:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919676:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919699:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015265408:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919720:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919740:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788305640.919746:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015264000:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919774:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919795:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015264512:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919830:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919849:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015265024:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919870:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919887:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015265536:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.919907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.919935:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264896 00000100:00100000:0.0:1788305640.919942:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264896 00000100:00100000:0.0:1788305640.919992:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265408 00000100:00100000:0.0:1788305640.919995:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265408 00000100:00100000:0.0:1788305640.920009:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265024 00000100:00100000:0.0:1788305640.920012:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265024 00000100:00100000:0.0:1788305640.920024:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265536 00000100:00100000:0.0:1788305640.920026:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265536 00000100:00100000:0.0:1788305640.920042:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305640.920050:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015264896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.920099:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015264896:12345-0@lo:400:kworker.0 Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305640.920106:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305640.920131:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305640.920137:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015265408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305640.920366:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305640.920371:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1875174015265024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920400:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3647:x1875174015265024:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920407:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788305640.920419:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305640.920425:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015265536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920450:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015265536:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920454:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788305640.920503:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264512 00000100:00100000:1.0:1788305640.920506:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264512 00000100:00100000:1.0:1788305640.920534:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788305640.920537:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015264512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920562:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015264512:12345-0@lo:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920565:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788305640.920580:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264000 00000100:00100000:1.0:1788305640.920584:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264000 00000100:00100000:1.0:1788305640.920604:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788305640.920610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015264000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3647:x1875174015264000:12345-0@lo:400:kworker.0 Request processed in 30us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920644:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1788305640.920666:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264384 00000100:00100000:1.0:1788305640.920668:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264384 00000100:00100000:1.0:1788305640.920684:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788305640.920687:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015264384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920706:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015264384:12345-0@lo:400:kworker.0 Request processed in 19us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920709:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00080000:1.0:1788305640.920728:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305640.920732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305640.920759:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015264000:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920772:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015264512:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015265024:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920790:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015265536:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920808:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015264384:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920829:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015264896:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.920875:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015263872 00000100:00100000:1.0:1788305640.920879:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015263872 00000100:00100000:1.0:1788305640.920905:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788305640.920912:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015263872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305640.920937:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305640.920975:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015263872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.920981:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788305640.921009:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015263872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305640.921565:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305640.921604:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305640.921625:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015264128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.921647:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.921725:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015265408:12345-0@lo:400:kworker.0 Request processed in 1587us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305640.921733:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305640.921766:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015265408:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.921802:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015263744:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305640.921835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.921853:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015264256:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.921876:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305640.921892:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015264768:0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.921923:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264256 00000100:00100000:0.0:1788305640.921927:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264256 00000100:00100000:0.0:1788305640.921960:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788305640.921968:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015264256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305640.922009:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015264256:12345-0@lo:400:kworker.0 Request processed in 43us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305640.922015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788305640.922094:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015263616 00000100:00100000:1.0:1788305640.922098:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015263616 00000100:00100000:1.0:1788305640.922120:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015263744 00000100:00100000:1.0:1788305640.922123:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015263744 00000100:00100000:1.0:1788305640.922137:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788305640.922143:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3649:x1875174015263616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305640.922179:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788305640.922212:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3649:x1875174015263616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.922218:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788305640.922230:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788305640.922236:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015263744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305640.922246:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788305640.922295:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015263744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.922313:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788305640.923068:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015264640:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.923105:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305640.923361:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015265152:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.923386:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305640.923527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264128 00000100:00100000:1.0:1788305640.923534:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264128 00000100:00100000:1.0:1788305640.923568:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264640 00000100:00100000:1.0:1788305640.923582:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264640 00000100:00100000:1.0:1788305640.923605:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788305640.923612:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015264128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.923657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015264128:12345-0@lo:400:kworker.0 Request processed in 46us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.923663:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788305640.923677:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788305640.923682:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015264640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.923707:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015264640:12345-0@lo:400:kworker.0 Request processed in 26us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.923712:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00080000:1.0:1788305640.923732:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305640.925483:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015265664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305640.925540:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305640.925611:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305640.925625:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015264128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925636:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015264640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305640.925679:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265152 00000100:00100000:3.0:1788305640.925680:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305640.925686:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265152 00000100:00100000:3.0:1788305640.925703:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015265280:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925726:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305640.925727:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015264768 00000100:00100000:1.0:1788305640.925730:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015264768 00000100:00100000:1.0:1788305640.925741:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265280 00000100:00100000:1.0:1788305640.925744:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265280 00000100:00100000:1.0:1788305640.925759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788305640.925767:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925768:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015263744:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305640.925780:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015264256:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925806:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265664 00000100:00100000:3.0:1788305640.925822:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265664 00000100:00100000:1.0:1788305640.925828:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015265152:12345-0@lo:400:kworker.0 Request processed in 62us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.925835:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788305640.925856:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788305640.925863:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015264768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925871:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788305640.925877:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015265664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305640.925889:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305640.925894:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015264768:12345-0@lo:400:kworker.0 Request processed in 32us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.925899:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:1.0:1788305640.925910:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788305640.925915:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015265280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.925919:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015265664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305640.925924:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788305640.925937:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015265280:12345-0@lo:400:kworker.0 Request processed in 22us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305640.925942:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00080000:3.0:1788305640.925957:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095880 x1875174015264768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788305640.925958:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305640.925962:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305640.925967:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015264768:0@lo:400:kworker.0 00010000:00080000:3.0:1788305640.925976:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095500 x1875174015265280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305640.925984:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015265280:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.926005:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015265152:0@lo:400:kworker.0 00000100:00100000:3.0:1788305640.926018:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015265664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788305641.559894:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305642.581433:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305642.966658:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015265792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305642.966728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1788305642.969083:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1788305642.971269:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1788305642.971307:0:8431:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1788305642.972166:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015265920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305642.972244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305642.972328:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265792 00000100:00100000:2.0:1788305642.972345:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265792 00000100:00100000:3.0:1788305642.972495:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015265920 00000100:00100000:3.0:1788305642.972501:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015265920 00000100:00100000:2.0:1788305642.972701:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788305642.972713:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015265792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305642.972757:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305642.972823:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015265792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305642.972909:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788305642.981692:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788305642.981711:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015265920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305642.981819:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788305642.981973:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015265920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 267us (9728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305642.982316:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015265920:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788305642.984036:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788305642.984067:0:6498:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8891bfa14000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788305642.984071:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889081087a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8891bfa14b40 00000020:00080000:1.0:1788305642.984075:0:6498:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff889081087000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff889083fbca00 00000020:00080000:1.0:1788305642.984092:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788305642.984110:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984120:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984139:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984145:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305642.984160:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984169:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984186:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8890825b7f00) 00010000:00010000:1.0:1788305642.984188:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305642.984194:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305642.984200:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e60544fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788305642.984477:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788305642.984539:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788305642.985144:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015265792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305642.991730:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788305643.135196:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135235:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135260:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135307:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135377:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135401:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135440:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305643.135470:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247296 00000100:00100000:3.0:1788305643.135478:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247296 00000100:00100000:3.0:1788305643.135529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 399 00000100:00100000:3.0:1788305643.135539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994247296:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.135606:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2395:x1875173994247296:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 68us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.135613:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 399 00000100:00100000:3.0:1788305643.135645:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247552 00000100:00100000:3.0:1788305643.135649:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247552 00000100:00100000:3.0:1788305643.135681:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248064 00000100:00100000:3.0:1788305643.135684:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248064 00000100:00100000:3.0:1788305643.135699:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247424 00000100:00100000:3.0:1788305643.135701:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247424 00000100:00100000:3.0:1788305643.135713:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247936 00000100:00100000:3.0:1788305643.135715:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247936 00000100:00100000:3.0:1788305643.135727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 368 00000100:00100000:3.0:1788305643.135733:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994247552:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.135765:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994247552:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.135772:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 368 00000100:00100000:3.0:1788305643.135784:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 369 00000100:00100000:3.0:1788305643.135804:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994248064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.135830:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994248064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.135837:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 369 00000100:00100000:3.0:1788305643.135849:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 370 00000100:00100000:3.0:1788305643.135865:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2395:x1875173994247424:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.135895:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:2395:x1875173994247424:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.135902:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 370 00000100:00100000:3.0:1788305643.135929:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 371 00000100:00100000:3.0:1788305643.135935:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994247936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.135959:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2395:x1875173994247936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.135965:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 371 00000100:00100000:3.0:1788305643.135984:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247808 00000100:00100000:3.0:1788305643.135987:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247808 00000100:00100000:3.0:1788305643.136013:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994247680 00000100:00100000:3.0:1788305643.136016:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994247680 00000100:00100000:3.0:1788305643.136032:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:3.0:1788305643.136038:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994247808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.136060:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2395:x1875173994247808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.136066:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 107 00000100:00100000:3.0:1788305643.136077:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00100000:3.0:1788305643.136083:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994247680:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305643.136107:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2395:x1875173994247680:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305643.136112:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 108 00000100:00080000:3.0:1788305643.136253:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305643.136263:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305643.136266:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305643.136267:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788305643.606002:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305644.629512:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305644.980321:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305644.980409:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248192 00000100:00100000:3.0:1788305644.980420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248192 00000100:00100000:3.0:1788305644.980477:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 255 00000100:00100000:3.0:1788305644.980488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:12156:x1875173994248192:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788305644.980595:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:12156:x1875173994248192:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 108us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305644.980602:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 255 00000100:00100000:3.0:1788305644.982768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305644.983412:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248320 00000100:00100000:2.0:1788305644.983428:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248320 00000100:00100000:2.0:1788305644.983499:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 256 00000100:00100000:2.0:1788305644.983511:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:12156:x1875173994248320:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788305644.983626:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:12156:x1875173994248320:12345-192.168.202.55@tcp:60:lhsmtool_posix.0 Request processed in 117us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305644.983634:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 256 00000100:00100000:2.0:1788305645.000038:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305645.000140:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248576 00000100:00100000:0.0:1788305645.000154:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248576 00000100:00100000:0.0:1788305645.000227:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788305645.000239:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:12156:x1875173994248576:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788305645.000535:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:12156:x1875173994248576:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 297us (510us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788305645.000561:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:1.0:1788305645.238481:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305645.238856:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248704 00000100:00100000:3.0:1788305645.238869:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248704 00000100:00100000:3.0:1788305645.238949:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 257 00000100:00100000:3.0:1788305645.238960:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:12962:x1875173994248704:12345-192.168.202.55@tcp:101:lsof.0 00010000:00010000:3.0:1788305645.238984:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305645.239008:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054589 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08774 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305645.239079:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305645.239093:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305645.239104:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305645.239158:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305645.239180:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305645.239214:0:6520:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305645.239242:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519c00/0x4a426866e6054589 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08774 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788305645.239327:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305645.239495:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08774 expref: 6 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305645.239503:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:3.0:1788305645.239505:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305645.239508:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305645.239680:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:12962:x1875173994248704:12345-192.168.202.55@tcp:101:lsof.0 Request processed in 720us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305645.239688:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 257 00010000:00010000:0.0:1788305645.653518:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305646.037702:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305646.037728:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015266048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305646.037828:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305646.037925:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266048 00000100:00100000:0.0:1788305646.037934:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266048 00000100:00100000:3.0:1788305646.037963:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015266304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305646.037996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305646.038017:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305646.038024:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015266176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305646.038048:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305646.038103:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305646.038229:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015266688:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038266:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038312:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015267200:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038345:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038363:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015267712:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038413:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038435:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788305646.038440:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015266816:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038461:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038478:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015267328:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038496:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038525:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266688 00000100:00100000:1.0:1788305646.038529:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266688 00000100:00100000:1.0:1788305646.038569:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788305646.038586:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015266688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038654:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015266688:12345-0@lo:400:kworker.0 Request processed in 75us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.038662:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788305646.038692:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267712 00000100:00100000:1.0:1788305646.038696:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267712 00000100:00100000:1.0:1788305646.038729:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267328 00000100:00100000:1.0:1788305646.038732:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267328 00000100:00100000:1.0:1788305646.038753:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305646.038761:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015267712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038809:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015267712:12345-0@lo:400:kworker.0 Request processed in 49us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.038815:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788305646.038829:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788305646.038835:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038860:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015267328:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.038865:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788305646.038896:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015266560:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038924:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038944:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015267072:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.038966:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.038984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015267584:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039005:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.039017:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305646.039084:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267200 00000100:00100000:2.0:1788305646.039088:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267200 00000100:00100000:2.0:1788305646.039115:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266816 00000100:00100000:2.0:1788305646.039119:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266816 00000100:00100000:2.0:1788305646.039131:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266560 00000100:00100000:2.0:1788305646.039141:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266560 00000100:00100000:2.0:1788305646.039157:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267072 00000100:00100000:2.0:1788305646.039160:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267072 00000100:00100000:2.0:1788305646.039174:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267584 00000100:00100000:2.0:1788305646.039176:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267584 00000100:00100000:2.0:1788305646.039191:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788305646.039198:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015267200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305646.039237:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015267200:12345-0@lo:400:kworker.0 Request processed in 40us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305646.039244:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788305646.039257:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788305646.039263:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015266816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305646.039307:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015266816:12345-0@lo:400:kworker.0 Request processed in 45us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305646.039314:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788305646.039325:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788305646.039331:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015266560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305646.039356:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015266560:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305646.039362:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1788305646.039374:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788305646.039380:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015267072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305646.039407:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015267072:12345-0@lo:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305646.039413:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788305646.039424:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788305646.039431:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015267584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305646.039470:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015267584:12345-0@lo:400:kworker.0 Request processed in 39us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305646.039476:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788305646.039648:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015266432:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.039737:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015266944:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039774:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.039792:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015267456:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039816:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305646.039853:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015266560:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039865:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015267072:0@lo:400:kworker.0 00010000:00080000:1.0:1788305646.039877:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb095880 x1875174015267584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305646.039887:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015267584:0@lo:400:kworker.0 00000100:00080000:1.0:1788305646.039924:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305646.039929:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305646.039932:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305646.039934:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305646.039952:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015266816:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039964:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015267328:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.039988:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015266688:0@lo:400:kworker.0 00010000:00080000:1.0:1788305646.040000:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184db6d80 x1875174015267200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305662 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305646.040010:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015267200:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040021:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1788305646.040028:0:3649:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff889184027100, transno 4294967311 00000100:00100000:1.0:1788305646.040042:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015267712:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040067:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305646.040073:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015267840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305646.040107:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267456 00000100:00100000:1.0:1788305646.040111:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267456 00000100:00100000:1.0:1788305646.040153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788305646.040160:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015267456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015267456:12345-0@lo:400:kworker.0 Request processed in 40us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.040206:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00080000:1.0:1788305646.040222:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305646.040238:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb095500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015267456:0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040458:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266944 00000100:00100000:1.0:1788305646.040462:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266944 00000100:00100000:1.0:1788305646.040491:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788305646.040498:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015266944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040537:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015266944:12345-0@lo:400:kworker.0 Request processed in 39us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.040555:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788305646.040575:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266432 00000100:00100000:1.0:1788305646.040579:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266432 00000100:00100000:1.0:1788305646.040608:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788305646.040614:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015266432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305646.040648:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015266432:12345-0@lo:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305646.040654:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1788305646.042600:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266304 00000100:00100000:0.0:1788305646.042618:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266304 00000100:00100000:0.0:1788305646.042735:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788305646.042747:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015266048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305646.042800:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305646.042908:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015266048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (5080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305646.042916:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788305646.042936:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788305646.042943:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015266304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305646.042960:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788305646.042994:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015266304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (4998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305646.042999:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788305646.043027:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305646.043077:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015266048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305646.043235:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015266432:0@lo:400:kworker.0 00000100:00100000:0.0:1788305646.043251:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015266944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305646.044446:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788305646.044461:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891903d4700, transno 4294967322 00000004:00080000:3.0:1788305646.044471:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891903d4e00, transno 4294967324 00000004:00080000:3.0:1788305646.044477:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788305646.044514:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015266304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305646.044803:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305646.045660:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015266176 00000100:00100000:0.0:1788305646.045728:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015266176 00000100:00100000:0.0:1788305646.045791:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267840 00000100:00100000:0.0:1788305646.045795:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267840 00000100:00100000:0.0:1788305646.045819:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788305646.045830:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015266176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305646.045863:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788305646.045977:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015266176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (7927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305646.045985:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788305646.046005:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788305646.046013:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015267840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305646.046025:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305646.047925:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015267840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1900us (3109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305646.047940:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788305646.048106:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015267840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305646.048342:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015266176:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788305646.677544:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305647.701721:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305648.085887:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305648.085922:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015267968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305648.086017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305648.088439:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305648.088465:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015268096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305648.088565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305648.095208:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015267968 00000100:00100000:0.0:1788305648.095230:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015267968 00000100:00100000:0.0:1788305648.095322:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268096 00000100:00100000:0.0:1788305648.095327:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268096 00000100:00100000:0.0:1788305648.095363:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788305648.095375:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015267968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305648.095426:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788305648.095548:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015267968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 174us (9530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305648.095556:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788305648.095578:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788305648.095606:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015268096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305648.095628:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788305648.095676:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015268096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (7111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305648.095682:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788305648.095760:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015268096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305648.098030:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015267968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305648.243647:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.243767:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.243811:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.243899:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.243927:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.243961:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305648.244021:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249088 00000100:00100000:2.0:1788305648.244037:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249088 00000100:00100000:2.0:1788305648.244123:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249600 00000100:00100000:2.0:1788305648.244127:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249600 00000100:00100000:2.0:1788305648.244142:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248960 00000100:00100000:2.0:1788305648.244145:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248960 00000100:00100000:2.0:1788305648.244165:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 378 00000100:00100000:2.0:1788305648.244177:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994249088:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305648.244324:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994249088:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 149us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305648.244334:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 378 00000100:00100000:2.0:1788305648.244354:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 379 00000100:00100000:2.0:1788305648.244360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994249600:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305648.244386:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2397:x1875173994249600:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305648.244393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 379 00000100:00100000:2.0:1788305648.244404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 380 00000100:00100000:2.0:1788305648.244411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:2397:x1875173994248960:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305648.244462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:2397:x1875173994248960:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 52us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305648.244469:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 380 00000100:00080000:2.0:1788305648.244650:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305648.244655:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305648.248196:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994248832 00000100:00100000:3.0:1788305648.248218:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994248832 00000100:00100000:3.0:1788305648.248313:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 401 00000100:00100000:3.0:1788305648.248325:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994248832:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305648.248439:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2397:x1875173994248832:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 115us (4945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305648.248447:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 401 00000100:00100000:1.0:1788305648.250377:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305648.250421:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249472 00000100:00100000:1.0:1788305648.250433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249472 00000100:00100000:1.0:1788305648.250506:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 381 00000100:00100000:1.0:1788305648.250518:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2397:x1875173994249472:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305648.250629:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2397:x1875173994249472:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 112us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305648.250654:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 381 00000100:00080000:1.0:1788305648.251711:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305648.261186:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249344 00000100:00100000:0.0:1788305648.261210:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249344 00000100:00100000:0.0:1788305648.261376:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249216 00000100:00100000:0.0:1788305648.261381:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249216 00000100:00100000:0.0:1788305648.261423:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:0.0:1788305648.261437:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994249344:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305648.261560:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2397:x1875173994249344:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 125us (17746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305648.261581:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 111 00000100:00100000:0.0:1788305648.261615:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00100000:0.0:1788305648.261622:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2397:x1875173994249216:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305648.261650:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2397:x1875173994249216:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (17701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305648.261656:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 112 00000100:00080000:2.0:1788305648.262810:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305648.262820:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788305648.278090:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788305648.597824:0:13804:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788305648.597838:0:13804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788305648.597970:0:13804:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:3.0:1788305648.597978:0:13804:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788305648.603716:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788305648.603732:0:6498:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788305648.605450:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788305648.605482:0:6551:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1788305648.728719:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305649.254705:0:14967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:34:07 (1788305647) 00010000:00010000:3.0:1788305649.753567:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305650.774439:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305651.157470:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305651.157495:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015268224:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305651.157566:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305651.157704:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268224 00000100:00100000:3.0:1788305651.157713:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268224 00000100:00100000:3.0:1788305651.157791:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305651.157804:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015268224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305651.157835:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788305651.157896:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015268224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305651.157904:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:2.0:1788305651.158019:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305651.158059:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015268224:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305651.158975:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305651.158989:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015268352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305651.159032:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.159043:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015268480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305651.159072:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.159111:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268352 00000100:00100000:0.0:1788305651.159116:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268352 00000100:00100000:2.0:1788305651.159130:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015268608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305651.159156:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.159163:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268480 00000100:00100000:0.0:1788305651.159166:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268480 00000100:00080000:2.0:1788305651.159181:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305651.159181:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268608 00000100:00100000:0.0:1788305651.159183:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268608 00000100:00080000:2.0:1788305651.159184:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305651.159192:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305651.159201:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788305651.159209:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015268352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305651.159231:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305651.159240:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305651.159248:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015268480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305651.159258:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788305651.159297:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015268352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305651.159304:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015268480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.159304:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788305651.159309:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788305651.159320:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788305651.159327:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015268608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305651.159336:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305651.159362:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015268608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305651.159367:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788305651.159368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015268480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305651.159391:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015268608:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305651.159466:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015268352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305651.159628:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015268736:0@lo:400:kworker.0 00000100:00100000:2.0:1788305651.159659:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305651.159689:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015269248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305651.159712:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305651.159733:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015269120:0@lo:400:kworker.0 00000100:00100000:2.0:1788305651.159749:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015269760:0@lo:400:kworker.0 00000100:00100000:1.0:1788305651.159759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305651.159800:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268736 00000100:00100000:3.0:1788305651.159805:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268736 00000100:00100000:3.0:1788305651.159833:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1788305651.159840:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015268736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.159901:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015268992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305651.159921:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269248 00000100:00100000:2.0:1788305651.159925:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269248 00000100:00100000:2.0:1788305651.159955:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788305651.159961:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015269248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305651.166617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:137eb269-2484-4047-a131-a502494b009f+24:3649:x1875174015268736:12345-0@lo:400:kworker.0 Request processed in 6768us (6947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305651.166632:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788305651.168288:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.168345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015269504:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168381:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.168470:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015268864:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168495:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.168513:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015269376:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168529:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.168563:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269120 00000100:00100000:0.0:1788305651.168570:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269120 00000100:00100000:0.0:1788305651.168605:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269504 00000100:00100000:0.0:1788305651.168607:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269504 00000100:00100000:0.0:1788305651.168625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268864 00000100:00100000:0.0:1788305651.168627:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268864 00000100:00100000:0.0:1788305651.168635:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269376 00000100:00100000:0.0:1788305651.168637:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269376 00000100:00100000:0.0:1788305651.168652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788305651.168673:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015269120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168733:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015269120:12345-0@lo:400:kworker.0 Request processed in 60us (8972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.168740:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788305651.168754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788305651.168760:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015269504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168788:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015269504:12345-0@lo:400:kworker.0 Request processed in 29us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.168793:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788305651.168803:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788305651.168808:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015268864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168831:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015268864:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.168836:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1788305651.168847:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788305651.168853:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015269376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.168876:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015269376:12345-0@lo:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.168881:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788305651.169514:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015268864:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.169528:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015269376:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.169559:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305651.169594:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015268736:0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.169610:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269760 00000100:00100000:0.0:1788305651.169621:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269760 00000100:00100000:0.0:1788305651.169645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788305651.169651:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015269760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305651.169691:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015269760:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305651.169697:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00080000:0.0:1788305651.169734:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890844f9880 x1875174015269760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305651.169746:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015269760:0@lo:400:kworker.0 00010000:00080000:0.0:1788305651.169771:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890844f8700 x1875174015269504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305667 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305651.169781:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015269504:0@lo:400:kworker.0 00000100:00100000:3.0:1788305651.169932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015268992 00000100:00100000:3.0:1788305651.169937:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015268992 00000100:00100000:3.0:1788305651.169959:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788305651.169967:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015268992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305651.170003:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015268992:12345-0@lo:400:kworker.0 Request processed in 37us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305651.170009:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788305651.172860:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015268992:0@lo:400:kworker.0 00000100:00080000:0.0:1788305651.173210:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305651.173217:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305651.173591:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015269248:12345-0@lo:400:kworker.0 Request processed in 13626us (13874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305651.173602:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788305651.174238:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015269120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305651.174252:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015269632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305651.174518:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305651.175541:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269632 00000100:00100000:2.0:1788305651.175552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269632 00000100:00100000:2.0:1788305651.175764:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788305651.175776:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015269632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305651.175851:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015269632:12345-0@lo:400:kworker.0 Request processed in 78us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305651.175858:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788305651.175923:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015269632:0@lo:400:kworker.0 00000100:00080000:3.0:1788305651.180139:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305651.180900:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015269248:0@lo:400:kworker.0 00010000:00010000:0.0:1788305651.797618:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305652.821488:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305653.141431:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305653.141776:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994249856 00000100:00100000:0.0:1788305653.141792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994249856 00000100:00100000:0.0:1788305653.141887:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:0.0:1788305653.141902:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+18:13185:x1875173994249856:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:0.0:1788305653.142255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:13185:x1875173994249856:12345-192.168.202.55@tcp:35:umount.0 Request processed in 355us (837us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788305653.142265:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00080000:3.0:1788305653.142718:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305653.149616:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305653.149956:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994250112 00000100:00100000:0.0:1788305653.149973:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994250112 00000100:00100000:0.0:1788305653.150067:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788305653.150080:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+19:13185:x1875173994250112:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:0.0:1788305653.150864:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:13185:x1875173994250112:12345-192.168.202.55@tcp:35:umount.0 Request processed in 781us (1259us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788305653.150875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:1.0:1788305653.161138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305653.161250:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994250368 00000100:00100000:2.0:1788305653.161260:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994250368 00000100:00100000:2.0:1788305653.161354:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:2.0:1788305653.161363:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891867b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+20:13185:x1875173994250368:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:2.0:1788305653.161593:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891867b3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:13185:x1875173994250368:12345-192.168.202.55@tcp:35:umount.0 Request processed in 230us (465us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788305653.161600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788305653.168672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305653.168773:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994250624 00000100:00100000:2.0:1788305653.168788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994250624 00000100:00100000:2.0:1788305653.168866:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:2.0:1788305653.168876:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:13185:x1875173994250624:12345-192.168.202.55@tcp:35:umount.0 00000100:00100000:2.0:1788305653.169158:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:13185:x1875173994250624:12345-192.168.202.55@tcp:35:umount.0 Request processed in 282us (501us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788305653.169166:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788305653.180946:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.180996:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.181115:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.190651:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.190772:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994251136 00000100:00100000:3.0:1788305653.190784:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994251136 00000100:00100000:3.0:1788305653.190871:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00100000:3.0:1788305653.190883:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994251136:12345-192.168.202.55@tcp:9:umount.0 00000020:00000080:3.0:1788305653.190924:0:14680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053885 00000100:00080000:3.0:1788305653.190936:0:14680:0:(import.c:65:import_set_state_nolock()) ffff8891bfa68800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305653.190997:0:14680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788305653.193420:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994250752 00000100:00100000:1.0:1788305653.193439:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994250752 00000100:00100000:3.0:1788305653.193896:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+2:2394:x1875173994251136:12345-192.168.202.55@tcp:9:umount.0 Request processed in 3006us (3250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305653.193913:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 80 00000100:00080000:3.0:1788305653.193975:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788305653.194409:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994251008 00010000:00010000:3.0:1788305653.194418:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305653.194419:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994251008 00000100:00100000:1.0:1788305653.194485:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994250880 00000100:00100000:1.0:1788305653.194488:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994250880 00000100:00100000:3.0:1788305653.195484:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305653.195504:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+15:2396:x1875173994250752:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305653.195530:0:6506:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305653.195560:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564a00/0x4a426866e60534e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082c7 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305653.195792:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305653.195814:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+15:2396:x1875173994251008:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305653.195834:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305653.195867:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a600/0x4a426866e6053782 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083a0 expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305653.195886:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305653.195960:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+14:2396:x1875173994251008:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 154us (14963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305653.195968:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305653.195992:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305653.195999:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+13:2396:x1875173994250880:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305653.196009:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305653.196018:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565000/0x4a426866e60534aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08288 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305653.196027:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305653.196043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+12:2396:x1875173994250880:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 45us (14929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305653.196070:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:3.0:1788305653.197353:0:6506:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305653.197655:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2396:x1875173994250752:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 2147us (16715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305653.197667:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305653.206497:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015269888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305653.206563:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305653.206673:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015269888 00000100:00100000:1.0:1788305653.206681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015269888 00000100:00100000:1.0:1788305653.206738:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788305653.206748:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015269888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305653.206784:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788305653.211725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.211793:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994251520 00000100:00100000:3.0:1788305653.211804:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994251520 00000100:00100000:3.0:1788305653.211883:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:3.0:1788305653.211896:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+7:2394:x1875173994251520:12345-192.168.202.55@tcp:9:umount.0 00000020:00000080:3.0:1788305653.211931:0:8436:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053afb 00000020:00010000:3.0:1788305653.211942:0:8436:0:(genops.c:1921:obd_stale_export_put()) Put export ffff889083e7b800: total 0 00000100:00080000:3.0:1788305653.211947:0:8436:0:(import.c:65:import_set_state_nolock()) ffff889183844000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305653.212007:0:8436:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788305653.212212:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994251520:12345-192.168.202.55@tcp:9:umount.0 Request processed in 317us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305653.212221:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000020:00010000:3.0:1788305653.212243:0:7461:0:(genops.c:1907:obd_stale_export_get()) Get export ffff889083e7b800: total 0 00010000:00010000:3.0:1788305653.212266:0:7461:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff889083e7b800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788305653.215002:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009bd0729f/0x4a426866e6054582 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0876d expref: 4 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305653.215100:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6053eb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0858a expref: 3 pid: 8758 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305653.215119:0:7461:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff889083e7b800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788305653.215162:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305653.215165:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305653.215169:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305653.215190:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305653.215899:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015270016:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305653.216001:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305653.216090:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270016 00000100:00100000:2.0:1788305653.216098:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270016 00000100:00100000:2.0:1788305653.216146:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788305653.216157:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015270016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305653.216205:0:7734:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788305653.216251:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015270016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305653.216258:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788305653.216324:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015270016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305653.217662:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015269888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 10907us (11090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305653.217673:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788305653.221485:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015269888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305653.224395:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305653.225642:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994252544 00000100:00100000:0.0:1788305653.225657:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994252544 00000100:00100000:0.0:1788305653.225735:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 258 00000100:00100000:0.0:1788305653.225746:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+22:2394:x1875173994252544:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:0.0:1788305653.225780:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60534b8 00000020:00010000:0.0:1788305653.225793:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8891bf942800: total 0 00000100:00080000:0.0:1788305653.225798:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8891bf943800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305653.225828:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788305653.226012:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+21:2394:x1875173994252544:12345-192.168.202.55@tcp:39:umount.0 Request processed in 266us (1631us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788305653.226023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 258 00000020:00010000:1.0:1788305653.226149:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8891bf942800: total 0 00010000:00010000:1.0:1788305653.226206:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8891bf942800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788305653.226245:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff88908337b300) 00010000:00010000:1.0:1788305653.226249:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305653.226256:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a400/0x4a426866e6053800 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083b5 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226315:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305653.226319:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305653.226323:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20200/0x4a426866e6054463 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08720 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226360:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305653.226363:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788305653.226368:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a200/0x4a426866e6053e9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08583 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226380:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305653.226383:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305653.226386:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6053b56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe084a3 expref: 17 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226400:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305653.226402:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788305653.226406:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8e00/0x4a426866e6053f38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085ad expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226419:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88908337bd00) 00010000:00010000:1.0:1788305653.226422:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305653.226425:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ba00/0x4a426866e60537e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ae expref: 15 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226439:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305653.226441:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305653.226445:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054543 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08758 expref: 14 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226455:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305653.226457:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305653.226480:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6053d94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0853d expref: 13 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226494:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8890825bb000) 00010000:00010000:1.0:1788305653.226497:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788305653.226501:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e605385b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe083ca expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226523:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8890825b7000) 00010000:00010000:1.0:1788305653.226526:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788305653.226532:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51000/0x4a426866e6053e74 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08575 expref: 11 pid: 10615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226561:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8891885c8100) 00010000:00010000:1.0:1788305653.226564:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788305653.226569:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20e00/0x4a426866e6054225 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08686 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226588:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:1.0:1788305653.226591:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305653.226594:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b600/0x4a426866e6053f1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe085a6 expref: 9 pid: 6521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226605:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff889186383400) 00010000:00010000:1.0:1788305653.226608:0:6508:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788305653.226611:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9400/0x4a426866e605456d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08766 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305653.226623:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8891bf942800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788305653.226645:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305653.226648:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305653.226649:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305653.245322:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305653.249393:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994252672 00000100:00100000:1.0:1788305653.249408:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994252672 00000100:00100000:1.0:1788305653.249507:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 259 00000100:00100000:1.0:1788305653.249520:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+5:2394:x1875173994252672:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:1.0:1788305653.249552:0:10615:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60534bf 00000100:00080000:1.0:1788305653.249571:0:10615:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305653.249596:0:10615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788305653.249844:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:52cc16d6-1587-44f4-a8e9-dfc0ecdc0891+3:2394:x1875173994252672:12345-192.168.202.55@tcp:39:umount.0 Request processed in 327us (4572us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788305653.249852:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 259 00010000:00010000:0.0:1788305653.250500:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305653.250722:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305653.360370:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305653.360405:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305653.360644:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994252800 00000100:00100000:3.0:1788305653.360654:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994252800 00000100:00100000:3.0:1788305653.360746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994252928 00000100:00100000:3.0:1788305653.360750:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994252928 00000100:00100000:3.0:1788305653.360776:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 388 00000100:00100000:3.0:1788305653.360785:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2398:x1875173994252800:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305653.360859:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2398:x1875173994252800:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 76us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305653.360866:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 388 00000100:00100000:3.0:1788305653.360880:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 389 00000100:00100000:3.0:1788305653.360885:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994252928:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305653.360907:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2398:x1875173994252928:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305653.360913:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 389 00000100:00080000:1.0:1788305653.361659:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305653.361666:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305653.845433:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305654.870485:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305655.126892:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305655.127035:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253056 00000100:00100000:0.0:1788305655.127046:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253056 00000100:00100000:0.0:1788305655.127120:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:0.0:1788305655.127131:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994253056:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305655.127148:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305655.127179:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eaa00/0x4a426866e60535bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082dc expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305655.127198:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305655.127325:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:2395:x1875173994253056:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 145us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305655.127335:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788305655.128982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305655.129023:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305655.129122:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253312 00000100:00100000:0.0:1788305655.129132:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253312 00000100:00100000:2.0:1788305655.129215:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253184 00000100:00100000:2.0:1788305655.129220:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253184 00000100:00100000:0.0:1788305655.129394:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788305655.129406:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+10:2395:x1875173994253312:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305655.129420:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305655.129437:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523b000/0x4a426866e605377b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08399 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305655.129451:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305655.129501:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+9:2395:x1875173994253312:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 98us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305655.129508:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:0.0:1788305655.129791:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:0.0:1788305655.129799:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+8:2395:x1875173994253184:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305655.129806:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305655.129815:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523a000/0x4a426866e60535c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0830d expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305655.129824:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305655.129930:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+7:2395:x1875173994253184:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 130us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305655.129936:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:3.0:1788305655.143831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305655.143912:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253568 00000100:00100000:2.0:1788305655.143922:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253568 00000100:00100000:2.0:1788305655.144019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 260 00000100:00080000:1.0:1788305655.144134:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305655.144360:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+6:2394:x1875173994253568:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:2.0:1788305655.144418:0:6521:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60535d0 00000020:00010000:2.0:1788305655.144428:0:6521:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8890825d5800: total 0 00000100:00080000:2.0:1788305655.144434:0:6521:0:(import.c:65:import_set_state_nolock()) ffff8890825d2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788305655.144650:0:6521:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788305655.144879:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2394:x1875173994253568:12345-192.168.202.55@tcp:39:umount.0 Request processed in 526us (1064us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788305655.144889:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 260 00000020:00010000:0.0:1788305655.144973:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8890825d5800: total 0 00010000:00010000:0.0:1788305655.144979:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305655.145052:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8890825d5800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788305655.145092:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b7a00) 00010000:00010000:0.0:1788305655.145096:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305655.145116:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518800/0x4a426866e6054590 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08774 expref: 4 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305655.145140:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8890825d5800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788305655.145153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305655.145155:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305655.145416:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305655.160248:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305655.161652:0:10615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253696 00000100:00100000:2.0:1788305655.161665:0:10615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253696 00000100:00100000:2.0:1788305655.161887:0:10615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 261 00000100:00100000:2.0:1788305655.161898:0:10615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+5:2394:x1875173994253696:12345-192.168.202.55@tcp:39:umount.0 00000020:00000080:2.0:1788305655.161943:0:10615:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60535d7 00000100:00080000:2.0:1788305655.161953:0:10615:0:(import.c:65:import_set_state_nolock()) ffff8891bf9af000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788305655.161985:0:10615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788305655.162196:0:10615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c1c667bf-adbd-4039-9541-664be6dfc9fd+3:2394:x1875173994253696:12345-192.168.202.55@tcp:39:umount.0 Request processed in 299us (1958us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788305655.162205:0:10615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 261 00010000:00010000:3.0:1788305655.162334:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305655.164806:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305655.210610:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305655.210846:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994253952 00000100:00100000:1.0:1788305655.210856:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994253952 00000100:00100000:1.0:1788305655.210919:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 403 00000100:00100000:1.0:1788305655.210930:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+7:2394:x1875173994253952:12345-192.168.202.55@tcp:251:umount.0 00000020:00000080:1.0:1788305655.210982:0:6512:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053495 00000020:00010000:1.0:1788305655.210991:0:6512:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8891bf9ae000: total 0 00000100:00080000:1.0:1788305655.210996:0:6512:0:(import.c:65:import_set_state_nolock()) ffff8891bf9ad000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788305655.211090:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:821845f3-84a8-4b1d-9b9a-704a9fd0cb91+3:2394:x1875173994253952:12345-192.168.202.55@tcp:251:umount.0 Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305655.211125:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 403 00000020:00010000:2.0:1788305655.211380:0:6508:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8891bf9ae000: total 0 00010000:00010000:2.0:1788305655.211432:0:6508:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8891bf9ae000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788305655.211469:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519800/0x4a426866e60534f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe082ce expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305655.211495:0:6508:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8891bf9ae000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788305655.211505:0:6508:0:(genops.c:885:class_export_put()) final put ffff8891bf9ae000/821845f3-84a8-4b1d-9b9a-704a9fd0cb91 00010000:00010000:2.0:1788305655.211525:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305655.211527:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305655.211529:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305655.211939:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf9ae000/821845f3-84a8-4b1d-9b9a-704a9fd0cb91 for MGS 00000020:00000080:1.0:1788305655.211984:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf9ad000 for MGS 00010000:00010000:2.0:1788305655.893694:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305656.277731:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015270144:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.277806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.277853:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015270656:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.277879:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.277896:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015271168:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.277919:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.277933:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015271680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.277952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.277975:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305656.277980:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015270528:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278017:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278035:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278055:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278092:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278118:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015270272:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278139:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278164:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015270784:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278186:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278200:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015271296:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278220:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278235:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788305656.278240:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015270400:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278292:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278309:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015270912:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278329:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278339:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278357:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305656.278406:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270144 00000100:00100000:2.0:1788305656.278413:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270144 00000100:00100000:2.0:1788305656.278588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788305656.278598:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015270144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278646:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891af20f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:137eb269-2484-4047-a131-a502494b009f+24:3648:x1875174015270144:12345-0@lo:400:kworker.0 Request processed in 50us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.278652:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1788305656.278696:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270656 00000100:00100000:2.0:1788305656.278700:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270656 00000100:00100000:2.0:1788305656.278725:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270400 00000100:00100000:2.0:1788305656.278728:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270400 00000100:00100000:2.0:1788305656.278739:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788305656.278745:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015270656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278775:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015270656:12345-0@lo:400:kworker.0 Request processed in 30us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.278780:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788305656.278791:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788305656.278796:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015270400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278816:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015270400:12345-0@lo:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.278820:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788305656.278841:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271168 00000100:00100000:2.0:1788305656.278845:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271168 00000100:00100000:2.0:1788305656.278871:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271680 00000100:00100000:2.0:1788305656.278874:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271680 00000100:00100000:2.0:1788305656.278882:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271040 00000100:00100000:2.0:1788305656.278884:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271040 00000100:00100000:2.0:1788305656.278895:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271552 00000100:00100000:2.0:1788305656.278897:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271552 00000100:00100000:2.0:1788305656.278909:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788305656.278913:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015271168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278940:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015271168:12345-0@lo:400:kworker.0 Request processed in 26us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.278947:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788305656.278959:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305656.278965:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015271680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.278990:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015271680:12345-0@lo:400:kworker.0 Request processed in 26us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.278996:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788305656.279005:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788305656.279011:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015271040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279034:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015271040:12345-0@lo:400:kworker.0 Request processed in 23us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.279040:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788305656.279051:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788305656.279056:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015271552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279080:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015271552:12345-0@lo:400:kworker.0 Request processed in 23us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.279095:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788305656.279114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270528 00000100:00100000:2.0:1788305656.279117:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270528 00000100:00100000:2.0:1788305656.279134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270272 00000100:00100000:2.0:1788305656.279136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270272 00000100:00100000:2.0:1788305656.279144:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270784 00000100:00100000:2.0:1788305656.279159:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270784 00000100:00100000:2.0:1788305656.279172:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271296 00000100:00100000:2.0:1788305656.279174:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271296 00000100:00100000:2.0:1788305656.279183:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015270912 00000100:00100000:2.0:1788305656.279186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015270912 00000100:00100000:2.0:1788305656.279197:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271424 00000100:00100000:2.0:1788305656.279199:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271424 00000100:00100000:2.0:1788305656.279211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788305656.279216:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015270528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015270528:12345-0@lo:400:kworker.0 Request processed in 33us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.279255:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788305656.279266:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788305656.279272:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015270272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279319:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015270272:12345-0@lo:400:kworker.0 Request processed in 47us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.279325:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788305656.279337:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788305656.279342:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015270784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279367:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb3aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015270784:12345-0@lo:400:kworker.0 Request processed in 25us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305656.279373:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1788305656.279392:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788305656.279399:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015271296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.279426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015271296:12345-0@lo:400:kworker.0 Request processed in 28us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.279560:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305656.279571:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015271808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305656.279601:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305656.279633:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788305656.279640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305656.279667:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015270912:12345-0@lo:400:kworker.0 Request processed in 28us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.279686:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788305656.279706:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788305656.279713:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305656.279739:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015271424:12345-0@lo:400:kworker.0 Request processed in 27us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.279745:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788305656.279785:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271808 00000100:00100000:0.0:1788305656.279789:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271808 00000100:00100000:0.0:1788305656.279813:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305656.279820:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015271808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788305656.279851:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788305656.279883:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015271808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.279889:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788305656.279913:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015271936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305656.279937:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305656.279975:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015271808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305656.280000:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015271936 00000100:00100000:0.0:1788305656.280003:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015271936 00000100:00100000:0.0:1788305656.280023:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788305656.280028:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015271936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788305656.280036:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788305656.280067:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015271936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.280073:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788305656.280099:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015271936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305656.281308:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015272064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305656.281353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305656.281392:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272064 00000100:00100000:0.0:1788305656.281398:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272064 00000100:00100000:0.0:1788305656.281430:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788305656.281449:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015272064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305656.281468:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788305656.281501:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015272064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305656.281515:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788305656.281554:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015272064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305656.282537:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00080000:2.0:1788305656.282601:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305656.282606:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305656.282609:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305656.282612:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305656.282641:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015270400:0@lo:400:kworker.0 00010000:00080000:2.0:1788305656.282658:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083791180 x1875174015270912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305656.282668:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015270912:0@lo:400:kworker.0 00010000:00080000:2.0:1788305656.282692:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bfaa6680 x1875174015271424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305656.282700:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015271424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282714:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015270272:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282726:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015270784:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282737:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015271296:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282778:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015270528:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282790:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015271040:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282801:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015271552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282826:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:3648:1875174015270144:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282838:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015270656:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282849:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015271168:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.282858:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015271680:0@lo:400:kworker.0 00000100:00100000:2.0:1788305656.284979:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015272192:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305656.285060:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305656.297346:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272192 00000100:00100000:3.0:1788305656.297359:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272192 00000100:00100000:3.0:1788305656.297418:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788305656.297428:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015272192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305656.297463:0:8439:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788305656.297547:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015272192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (12486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305656.297554:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788305656.297603:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015272192:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788305656.917371:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788305657.311191:0:15163:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1788305657.348560:0:15163:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788305657.348615:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.348629:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.348638:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.348645:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.348693:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788305657.348698:0:15163:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788305657.348726:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788305657.348732:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788305657.348738:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788305657.348762:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891894ce000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788305657.348808:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015272320:0@lo:39:umount.0 00000100:00100000:3.0:1788305657.348876:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305657.348976:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305657.348983:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.348991:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305657.348994:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.349004:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305657.349011:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305657.349018:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305657.349021:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788305657.349023:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788305657.349052:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.349059:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305657.349086:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.349093:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e605354b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053552 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.349115:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.349117:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.349118:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305657.349133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272320 00000100:00100000:0.0:1788305657.349151:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272320 00000100:00100000:0.0:1788305657.349199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788305657.349209:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875174015272320:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788305657.349235:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60530ac 00000100:00080000:0.0:1788305657.349243:0:6519:0:(import.c:65:import_set_state_nolock()) ffff8891b8f75000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788305657.349498:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3646:x1875174015272320:12345-0@lo:39:umount.0 Request processed in 290us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.349506:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788305657.349515:0:6519:0:(genops.c:885:class_export_put()) final put ffff8891b8f73000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1788305657.349551:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305657.349560:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015272448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.349589:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788305657.349621:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788305657.349630:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8f73000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305657.349681:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b8f75000 for lustre-MDT0000 00000100:00100000:0.0:1788305657.349696:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272448 00000100:00100000:0.0:1788305657.349700:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272448 00000100:00100000:0.0:1788305657.349730:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305657.349737:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015272448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305657.349747:0:7471:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305657.349763:0:7471:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565c00/0x4a426866e6053552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605354b expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.349788:0:7471:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305657.349815:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:137eb269-2484-4047-a131-a502494b009f+23:3650:x1875174015272448:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.349821:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788305657.349856:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015272448:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788305657.349882:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894ce000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788305657.349889:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015272320:0@lo:39:umount.0 00000100:00080000:3.0:1788305657.355497:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788305657.355506:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788305657.355512:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788305657.356457:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356472:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356479:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356487:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356514:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305657.356520:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356526:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356546:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356552:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356564:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305657.356570:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356576:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356583:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356589:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356598:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788305657.356603:0:15163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356610:0:15163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356616:0:15163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356632:0:15163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305657.356640:0:15163:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788305657.356644:0:15163:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788305657.356686:0:15163:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788305657.356690:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788305657.356694:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305657.356699:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1788305657.356707:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8890820ba000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788305657.356712:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8891b8f71800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788305657.356717:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8891b9157000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788305657.356721:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8891b90fd800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788305657.356729:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8890825d5800 c1c667bf-adbd-4039-9541-664be6dfc9fd 192.168.202.55@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788305657.356734:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8891bf942800 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 192.168.202.55@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:3.0:1788305657.356739:0:15163:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff88918402cd28) has exports, disconnecting them 00000020:00080000:3.0:1788305657.356743:0:15163:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8890820ba000), last request at 1788305656 00000020:00000080:3.0:1788305657.356750:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60533bc 00000100:00080000:3.0:1788305657.356769:0:15163:0:(import.c:65:import_set_state_nolock()) ffff889082764800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788305657.356820:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8890820ba000): rc 0 00000020:00000080:3.0:1788305657.356822:0:15163:0:(genops.c:885:class_export_put()) final put ffff8890820ba000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788305657.356830:0:15163:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8891b8f71800), last request at 1788305656 00000020:00000080:3.0:1788305657.356833:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053296 00000100:00080000:3.0:1788305657.356838:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891b8f77800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788305657.356843:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891b8f71800): rc 0 00000020:00000080:3.0:1788305657.356850:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891b8f71800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788305657.356854:0:15163:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8891b9157000), last request at 1788305402 00000020:00000080:3.0:1788305657.356857:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053193 00000100:00080000:3.0:1788305657.356860:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891b9153800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788305657.356867:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891b9157000): rc 0 00000020:00000080:3.0:1788305657.356869:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891b9157000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788305657.356872:0:15163:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8891b90fd800), last request at 1788305402 00000020:00000080:3.0:1788305657.356874:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053154 00000100:00080000:3.0:1788305657.356877:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891b9174800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305657.356882:0:15163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:3.0:1788305657.356957:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891b90fd800): rc 0 00000004:00000080:3.0:1788305657.356962:0:15163:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff94a3c169bae0 00000100:00080000:3.0:1788305657.356979:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788305657.356983:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788305657.357791:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788305657.357819:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891bb19c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788305657.358741:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788305657.358753:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358765:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523a800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305657.358769:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358780:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305657.358788:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305657.358806:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305657.358809:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788305657.358812:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788305657.358851:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358875:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305657.358903:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358911:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523a800/0x4a426866e6053559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053560 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358927:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788305657.358932:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358938:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523b200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305657.358941:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358948:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305657.358955:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305657.358960:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305657.358962:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788305657.358965:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788305657.358977:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.358983:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305657.358999:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359016:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523b200/0x4a426866e605344f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053456 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359037:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305657.359040:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359046:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305657.359050:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359057:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305657.359063:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305657.359068:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788305657.359071:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788305657.359073:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788305657.359088:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359094:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305657.359100:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359107:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183564400/0x4a426866e60537b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ba expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359127:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305657.359131:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359137:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305657.359140:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359147:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305657.359153:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305657.359158:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305657.359161:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788305657.359162:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788305657.359178:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359184:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305657.359189:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359196:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683c00/0x4a426866e605300b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053012 expref: -99 pid: 6496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359205:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.359207:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.359213:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.359221:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.359225:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788305657.359234:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8890820ba000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305657.359307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8f71800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305657.359325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9157000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305657.359389:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082764800 for lustre-MDT0000 00000020:00000080:0.0:1788305657.359395:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b8f77800 for lustre-MDT0000 00000020:00000080:0.0:1788305657.359398:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b9153800 for lustre-MDT0000 00000100:00100000:0.0:1788305657.359485:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015272704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.359556:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.359593:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305657.359599:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015273088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.359619:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.359646:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015272832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.359680:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.359697:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305657.359702:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015272960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.359728:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.359761:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272704 00000100:00100000:0.0:1788305657.359768:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272704 00000100:00100000:0.0:1788305657.359806:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273088 00000100:00100000:0.0:1788305657.359809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273088 00000100:00100000:0.0:1788305657.359820:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272832 00000100:00100000:0.0:1788305657.359828:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272832 00000100:00100000:0.0:1788305657.359841:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272960 00000100:00100000:0.0:1788305657.359843:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272960 00000100:00100000:0.0:1788305657.359858:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305657.359867:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+26:3650:x1875174015272704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305657.359888:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305657.359903:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564c00/0x4a426866e6053560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053559 expref: 26 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.359915:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305657.359949:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+25:3650:x1875174015272704:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.359957:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788305657.359973:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305657.359980:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+24:3650:x1875174015273088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305657.360449:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305657.360464:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181682800/0x4a426866e6053012 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605300b expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.360478:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305657.360509:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+23:3650:x1875174015273088:12345-0@lo:103:ldlm_bl.0 Request processed in 530us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.360517:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305657.360538:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305657.360546:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+22:3647:x1875174015272832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305657.360555:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:3.0:1788305657.360557:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788305657.360564:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00010000:00010000:0.0:1788305657.360566:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523b400/0x4a426866e6053456 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605344f expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788305657.360580:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:0.0:1788305657.360580:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305657.360613:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+21:3647:x1875174015272832:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.360629:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305657.360641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305657.360646:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+20:3647:x1875174015272960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305657.360653:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305657.360675:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565e00/0x4a426866e60537ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60537b3 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305657.360685:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305657.360708:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:137eb269-2484-4047-a131-a502494b009f+19:3647:x1875174015272960:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.360713:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305657.360758:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015273088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.360768:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:137eb269-2484-4047-a131-a502494b009f:3650:1875174015272704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305657.360800:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015272960:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788305657.360802:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788305657.360810:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015272832:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788305657.360821:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8890825d6000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788305657.360833:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788305657.360833:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015272576:0@lo:39:umount.0 00000100:00100000:3.0:1788305657.360838:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788305657.360850:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305657.360871:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.360903:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015273216:0@lo:9:umount.0 00000100:00080000:3.0:1788305657.360920:0:15163:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788305657.360932:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891b8d02800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788305657.360933:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.360962:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015273344:0@lo:9:umount.0 00000020:00080000:3.0:1788305657.360970:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88918402cd28) has no exports 00000100:00100000:0.0:1788305657.360988:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305657.361021:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015272576 00000100:00100000:0.0:1788305657.361026:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015272576 00000100:00100000:0.0:1788305657.361068:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788305657.361075:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015272576:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788305657.361100:0:7734:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60531ee 00000100:00080000:0.0:1788305657.361108:0:7734:0:(import.c:65:import_set_state_nolock()) ffff8891b9156000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788305657.361131:0:7734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788305657.361305:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3646:x1875174015272576:12345-0@lo:39:umount.0 Request processed in 229us (433us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788305657.361312:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788305657.361332:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273216 00000100:00100000:0.0:1788305657.361335:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273216 00000100:00100000:0.0:1788305657.361365:0:14680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273344 00010000:00010000:3.0:1788305657.361367:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305657.361369:0:14680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273344 00000100:00100000:3.0:1788305657.361565:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305657.361573:0:14680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788305657.361576:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015273216:12345-0@lo:9:umount.0 00000100:00100000:0.0:1788305657.361587:0:14680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3646:x1875174015273344:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788305657.361595:0:8758:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053345 00000100:00080000:3.0:1788305657.361602:0:8758:0:(import.c:65:import_set_state_nolock()) ffff889082757800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788305657.361606:0:14680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053480 00000100:00080000:0.0:1788305657.361613:0:14680:0:(import.c:65:import_set_state_nolock()) ffff8891bf942000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305657.362218:0:8758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:0.0:1788305657.362227:0:14680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788305657.362387:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3646:x1875174015273216:12345-0@lo:9:umount.0 Request processed in 813us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305657.362388:0:14680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3646:x1875174015273344:12345-0@lo:9:umount.0 Request processed in 804us (1399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305657.362403:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305657.362415:0:14680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788305657.362445:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305657.362454:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305657.362492:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891b8d02800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788305657.362508:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788305657.362510:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305657.362514:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015273344:0@lo:9:umount.0 00000100:00080000:0.0:1788305657.362529:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890825d6000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788305657.362539:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788305657.362550:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305657.362554:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015273216:0@lo:9:umount.0 00000100:00080000:0.0:1788305657.362577:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb19c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788305657.362582:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015272576:0@lo:39:umount.0 00000020:00080000:0.0:1788305657.385464:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff88918402cd28) has no exports 00000020:00000080:0.0:1788305657.431919:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053066 00000020:00000080:0.0:1788305657.431936:0:15163:0:(genops.c:885:class_export_put()) final put ffff889182c86800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788305657.431963:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788305657.432099:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889182c86800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788305657.432123:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305657.432207:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305657.432213:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8891867899b8) has no exports 00000020:00000080:1.0:1788305657.432844:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605305f 00000020:00000080:1.0:1788305657.432851:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891b8d01800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788305657.432895:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305657.432903:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788305657.432906:0:15163:0:(genops.c:885:class_export_put()) final put ffff88918c9f0800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788305657.432908:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff88918c9f0800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788305657.432915:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788305657.434636:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8d01800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788305657.942579:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305658.326682:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305658.326705:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015273472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305658.326780:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305658.327041:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273472 00000100:00100000:2.0:1788305658.327050:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273472 00000100:00100000:2.0:1788305658.327103:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788305658.327111:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875174015273472:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788305658.327117:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788305658.327178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1875174015273472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (397us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788305658.327184:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:02020000:3.0:1788305658.329842:0:3649:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788305658.337487:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788305658.337495:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788305658.337501:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788305658.342990:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305658.343005:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 232 00000100:00080000:3.0:1788305658.343014:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8891badeb000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305658.343061:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa6300 x1875174015273600/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305658.344591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015273600:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788305658.344690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305658.348258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273600 00000100:00100000:3.0:1788305658.348285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273600 00000100:00100000:3.0:1788305658.348340:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788305658.348348:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015273600:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788305658.348366:0:6525:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788305658.358877:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015273600:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 10519us (14178us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788305658.358908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00080000:0.0:1788305658.359242:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305658.359248:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305658.359252:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015273600:0@lo:38:ptlrpcd_00_02.0 00000040:00080000:2.0:1788305658.518033:0:13807:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1788305658.841421:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305658.841431:0:8431:0:(genops.c:885:class_export_put()) final put ffff889082754000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788305658.841455:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:2.0:1788305658.841458:0:8431:0:(genops.c:885:class_export_put()) final put ffff889083e7b800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:00100000:0.0:1788305658.842499:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788305658.842515:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788305658.842521:0:7450:0:(genops.c:885:class_export_put()) final put ffff8891bb19d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788305658.842529:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00080000:0.0:1788305658.842534:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788305658.842537:0:7450:0:(genops.c:885:class_export_put()) final put ffff8891bf9ab000/c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:0.0:1788305658.842542:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:00080000:0.0:1788305658.842546:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788305658.842548:0:7450:0:(genops.c:885:class_export_put()) final put ffff8891bf940800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:3.0:1788305658.850122:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889082754000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788305658.850202:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889083e7b800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-OST0000 00000020:00000080:3.0:1788305658.850223:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb19d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788305658.850256:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf9ab000/c1c667bf-adbd-4039-9541-664be6dfc9fd for lustre-MDT0001 00000020:00000080:3.0:1788305658.850319:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf940800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-MDT0001 00000020:00000080:3.0:1788305658.850351:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082757800 for lustre-OST0000 00000020:00000080:3.0:1788305658.850356:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889183844000 for lustre-OST0000 00000020:00000080:3.0:1788305658.850363:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b9156000 for lustre-MDT0001 00000020:00000080:3.0:1788305658.850367:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf9af000 for lustre-MDT0001 00000020:00000080:3.0:1788305658.850370:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf99f000 for lustre-MDT0001 00000001:00100000:3.0:1788305658.851618:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788305658.851626:0:9516:0:(genops.c:885:class_export_put()) final put ffff8891bf946800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788305658.851658:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:3.0:1788305658.851661:0:9516:0:(genops.c:885:class_export_put()) final put ffff8891bfa6c800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:00100000:1.0:1788305658.851745:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788305658.851749:0:6498:0:(genops.c:885:class_export_put()) final put ffff8891b90fd800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788305658.851760:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00080000:1.0:1788305658.851768:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788305658.851772:0:6498:0:(genops.c:885:class_export_put()) final put ffff8890825d5800/c1c667bf-adbd-4039-9541-664be6dfc9fd 00000001:00100000:1.0:1788305658.851776:0:6498:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000001:00080000:1.0:1788305658.851780:0:6498:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788305658.851785:0:6498:0:(genops.c:885:class_export_put()) final put ffff8891bf942800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 00000020:00000080:0.0:1788305658.851950:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf946800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788305658.852002:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bfa6c800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-OST0001 00000020:00000080:0.0:1788305658.852019:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b90fd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788305658.852061:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8890825d5800/c1c667bf-adbd-4039-9541-664be6dfc9fd for lustre-MDT0000 00000020:00000080:0.0:1788305658.852103:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf942800/52cc16d6-1587-44f4-a8e9-dfc0ecdc0891 for lustre-MDT0000 00000020:00000080:0.0:1788305658.852126:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf942000 for lustre-OST0001 00000020:00000080:0.0:1788305658.852131:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bfa68800 for lustre-OST0001 00000020:00000080:0.0:1788305658.852134:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b9174800 for lustre-MDT0000 00000020:00000080:0.0:1788305658.852137:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890825d2000 for lustre-MDT0000 00000020:00000080:0.0:1788305658.852140:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf943800 for lustre-MDT0000 00010000:00010000:0.0:1788305658.965912:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788305659.477582:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891bb1a40c0 - data ffff88919df14360/ffff8891bb4e2000 00000020:01000000:3.0:1788305659.477757:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889187319e40 - data ffff88919dcc5948/ffff8891af3f1800 00000001:00000004:3.0:1788305659.486250:0:15163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788305659.543147:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788305659.543156:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788305659.543172:0:15163:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8891bfaa6a00 x1875174015272576/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788305667 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305659.543218:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788305659.547939:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788305659.547949:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788305659.547976:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788305659.547980:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788305659.548486:0:8754:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788305659.548491:0:8754:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788305659.548502:0:8754:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788305659.549043:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788305659.549048:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1788305659.549066:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788305659.549068:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788305659.549479:0:9965:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788305659.549483:0:9965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1788305659.549491:0:9965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788305659.553083:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605302e 00000020:00000080:2.0:1788305659.553096:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891894ca000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788305659.553251:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894ca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788305659.556673:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053043 00000020:00000080:2.0:1788305659.556687:0:15163:0:(genops.c:885:class_export_put()) final put ffff88918404c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788305659.556736:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788305659.556741:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305659.556749:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788305659.556753:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff889184028000) has no exports 00000004:01000000:2.0:1788305659.556908:0:15163:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788305659.556916:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053479 00000020:00000080:2.0:1788305659.556920:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891bf9ac800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788305659.558397:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918404c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788305659.565541:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788305659.565574:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305659.565591:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788305659.565596:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8890833db370) has no exports 00000020:00000080:2.0:1788305659.565605:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053472 00000020:00000080:2.0:1788305659.565613:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891bd789000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788305659.570973:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bf9ac800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788305659.573510:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305659.573518:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788305659.573522:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788305659.573529:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305659.573544:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305659.573580:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305659.573594:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305659.573602:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053337 00000020:00000080:1.0:1788305659.573613:0:15163:0:(genops.c:885:class_export_put()) final put ffff889082750800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305659.573619:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788305659.573624:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305659.573630:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305659.573633:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8891b8fa4d28) has no exports 00000020:00000080:1.0:1788305659.573650:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053330 00000020:00000080:1.0:1788305659.573655:0:15163:0:(genops.c:885:class_export_put()) final put ffff8890825d4800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788305659.573978:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788305659.573982:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788305659.573984:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788305659.573987:0:15163:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788305659.573989:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305659.574009:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305659.574014:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788305659.574026:0:15163:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788305659.574032:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60531e7 00000020:00000080:1.0:1788305659.574036:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891bb1b8000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788305659.574039:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788305659.574043:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305659.574046:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305659.574049:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8891b9178000) has no exports 00000020:00000080:1.0:1788305659.574052:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60531e0 00000020:00000080:1.0:1788305659.574054:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891bb199000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788305659.575108:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd789000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788305659.575121:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b8d02800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788305659.575128:0:38:0:(genops.c:885:class_export_put()) final put ffff889082766000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788305659.575130:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889082766000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788305659.575135:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305659.575232:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889082750800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788305659.575237:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8890825d4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788305659.575240:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890825d6000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788305659.575246:0:38:0:(genops.c:885:class_export_put()) final put ffff8890825d0000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788305659.575247:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8890825d0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788305659.575250:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305659.575297:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1b8000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788305659.575302:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb199000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788305659.575325:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788305659.575339:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788305659.575342:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788305659.575347:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788305659.575392:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305659.575413:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305659.575440:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305659.575443:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305659.575446:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891894cc800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788305659.575449:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894cc800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788305659.575453:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305659.575504:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605304a 00000020:00000080:0.0:1788305659.575510:0:15163:0:(genops.c:885:class_export_put()) final put ffff88918404f800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788305659.575514:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788305659.575516:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305659.575520:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788305659.575522:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8891840299b8) has no exports 00000020:00000080:0.0:1788305659.575541:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305659.575543:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788305659.575546:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053051 00000020:00000080:0.0:1788305659.575549:0:15163:0:(genops.c:885:class_export_put()) final put ffff88918404d000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788305659.575556:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88918c9a3800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788305659.575559:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a3800 3 00000020:01000004:0.0:1788305659.575562:0:15163:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88918c9a3800 from lustre-MDT0000 00000020:00000080:0.0:1788305659.575577:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305659.575580:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788305659.575582:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891894ce800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788305659.575584:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894ce800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788305659.575590:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788305659.575615:0:15163:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788305659.575618:0:15163:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788305659.575621:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788305659.575623:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305659.575630:0:15163:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305659.575636:0:15163:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8891a5296000 137eb269-2484-4047-a131-a502494b009f 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305659.575651:0:15163:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff889186273370) has exports, disconnecting them 00000020:00080000:0.0:1788305659.575656:0:15163:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8891a5296000), last request at 1788305381 00000020:00000080:0.0:1788305659.575669:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6052fef 00000020:00010000:0.0:1788305659.575673:0:15163:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8891a5296000: total 2 00000100:00080000:0.0:1788305659.575676:0:15163:0:(import.c:65:import_set_state_nolock()) ffff8891a5291800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788305659.575688:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891a5296000): rc 0 00000020:00080000:0.0:1788305659.575692:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff889186273370) has no exports 00000020:00010000:0.0:1788305659.575701:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8891a5296000: total 2 00010000:00010000:0.0:1788305659.575722:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8891a5296000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788305659.575749:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891a523aa00/0x4a426866e60534fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60534f7 expref: 14 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575766:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50a00/0x4a426866e60537ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60537a5 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575776:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564200/0x4a426866e6053410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053409 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575787:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564600/0x4a426866e605356e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053567 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575797:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891bb3eb800/0x4a426866e605350c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053505 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575807:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565400/0x4a426866e605351a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053513 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575816:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565a00/0x4a426866e6053528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053521 expref: 8 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575838:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565800/0x4a426866e6053536 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605352f expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575848:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181666800/0x4a426866e60530eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60530e4 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575860:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51800/0x4a426866e6053790 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053789 expref: 5 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575870:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564800/0x4a426866e605379e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e6053797 expref: 4 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575881:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564000/0x4a426866e6053544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e605353d expref: 3 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575892:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181683800/0x4a426866e60530f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4a426866e60530f2 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305659.575903:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8891a5296000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788305659.575916:0:6507:0:(genops.c:885:class_export_put()) final put ffff8891a5296000/137eb269-2484-4047-a131-a502494b009f 00010000:00010000:0.0:1788305659.575921:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305659.575923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305659.575925:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305659.576236:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8891a521da00:6513] 1 exiting: rc = 0 00000100:00100000:2.0:1788305659.576355:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8891a521cc00:6512] 0 exiting: rc = 1 00000020:00000080:2.0:1788305659.576392:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bb19c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788305659.576512:0:38:0:(genops.c:885:class_export_put()) final put ffff8891b8f72000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788305659.576515:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8f72000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788305659.576527:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788305659.576577:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918404f800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788305659.576580:0:38:0:(genops.c:885:class_export_put()) final put ffff88918404d800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788305659.576582:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918404d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788305659.576585:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788305659.576609:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918404d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788305659.576613:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891a5296000/137eb269-2484-4047-a131-a502494b009f for MGS 00000020:00000080:2.0:1788305659.576636:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891a5291800 for MGS 00000100:00100000:3.0:1788305659.576795:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff88918ab37600:6514] 2 exiting: rc = 0 00000100:00100000:0.0:1788305659.577073:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577080:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577087:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577092:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577098:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577104:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577110:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577123:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577129:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577136:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577142:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577149:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577154:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577159:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577165:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577189:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577196:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577201:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577208:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577215:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577220:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577226:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577232:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577237:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577242:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577247:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577253:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577264:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577270:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577310:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577316:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577322:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577327:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577333:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577338:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577343:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577349:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577355:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577360:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577366:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577372:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577377:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577390:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577395:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577537:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577546:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577551:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577556:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577562:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577567:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577572:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577578:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577583:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577588:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577594:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577598:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577603:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577608:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577613:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577618:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577624:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577629:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577635:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305659.577650:0:15163:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788305659.578674:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8890835200c0 - data ffff88919dc5a6c0/ffff8890826c2400 00000020:01000000:0.0:1788305659.578791:0:15163:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88918a512960 - data ffff88919dc046c0/ffff8891863a5400 00000020:00000080:0.0:1788305659.579540:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6052fd3 00000020:00000080:0.0:1788305659.579550:0:15163:0:(genops.c:885:class_export_put()) final put ffff88918caa6800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788305659.579571:0:15163:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88918c9a3800 from MGS, refs=2 00000020:01000004:0.0:1788305659.579575:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a3800 2 00000020:01000004:0.0:1788305659.579578:0:15163:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff88918c9a3800 from MGS 00000020:00000080:0.0:1788305659.579599:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305659.579606:0:15163:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788305659.579608:0:15163:0:(genops.c:885:class_export_put()) final put ffff889184def000/MGS 00000020:00000080:0.0:1788305659.579611:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff889184def000/MGS for MGS 00000020:01000000:0.0:1788305659.579617:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788305659.579704:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788305659.579707:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305659.579713:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305659.579720:0:15163:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8891894c9800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305659.579725:0:15163:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff889186270000) has exports, disconnecting them 00000020:00080000:0.0:1788305659.579729:0:15163:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8891894c9800), last request at 1788305381 00000020:00000080:0.0:1788305659.579733:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605309e 00000020:00080000:0.0:1788305659.579744:0:15163:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891894c9800): rc 0 00000020:00000080:0.0:1788305659.579748:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891894c9800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788305659.580364:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff88918caa6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788305659.580375:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894c9800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788305659.611354:0:15163:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788305659.611364:0:15163:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305659.611369:0:15163:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788305659.611376:0:15163:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305659.611424:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891894ce000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788305659.611606:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305659.611616:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788305659.611621:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891894c9000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788305659.611625:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894c9000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788305659.611636:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788305659.611724:0:15163:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a3800 1 00000020:00000080:2.0:1788305659.611734:0:15163:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6052fc5 00000020:00000080:2.0:1788305659.611742:0:15163:0:(genops.c:885:class_export_put()) final put ffff889184dec000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788305659.611751:0:15163:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788305659.611759:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff889184dec000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788305659.611770:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305659.611775:0:15163:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788305659.611779:0:15163:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8891862219b8) has no exports 00000020:00000080:3.0:1788305659.789753:0:15163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305659.789767:0:15163:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788305659.789773:0:15163:0:(genops.c:885:class_export_put()) final put ffff8891af3fc000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788305659.789778:0:15163:0:(genops.c:844:class_export_destroy()) destroying export ffff8891af3fc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788305659.789789:0:15163:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788305659.789895:0:15163:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff88918c9a0000 00000020:02000400:3.0:1788305659.789953:0:15163:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788305659.990715:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305661.014096:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305661.416444:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305661.416454:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788305661.416459:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305661.416470:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1788305661.416476:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788305661.416485:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8891badeb000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305661.416513:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bfaa4700 x1875174015273856/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305661.416605:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015273728:0@lo:400:kworker.0 00000400:00000100:3.0:1788305661.416692:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015273728 offset 0 length 224: 4 00000100:00100000:3.0:1788305661.416751:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015274368:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.416791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.416820:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305661.416826:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015273984:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.416853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.416870:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015274496:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.416891:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.416961:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015273856:0@lo:38:kworker.0 00000100:00100000:3.0:1788305661.417006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.417038:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015274112:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.417065:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.417084:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.417111:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.417153:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788305661.417159:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015274240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.417183:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.417193:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015274752:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.417213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.417251:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273984 00000100:00100000:3.0:1788305661.417260:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273984 00000100:00100000:3.0:1788305661.417688:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274496 00000100:00100000:3.0:1788305661.417693:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274496 00000100:00100000:3.0:1788305661.417705:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274112 00000100:00100000:3.0:1788305661.417708:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274112 00000100:00100000:3.0:1788305661.417717:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274624 00000100:00100000:3.0:1788305661.417719:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274624 00000100:00100000:3.0:1788305661.417907:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274240 00000100:00100000:3.0:1788305661.417911:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274240 00000100:00100000:3.0:1788305661.417934:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788305661.417943:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015274624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.418015:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015274624:12345-0@lo:400:kworker.0 Request processed in 72us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305661.418022:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788305661.418043:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788305661.418050:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015274240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.418093:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015274240:12345-0@lo:400:kworker.0 Request processed in 43us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305661.418099:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788305661.418112:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788305661.418116:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875174015273984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788305661.418124:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788305661.418172:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875174015273984:12345-0@lo:400:kworker.0 Request processed in 53us (1318us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305661.418179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788305661.418193:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788305661.418197:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875174015274496:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788305661.418201:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788305661.418222:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3647:x1875174015274496:12345-0@lo:400:kworker.0 Request processed in 24us (1330us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305661.418228:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788305661.418239:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788305661.418243:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875174015274112:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788305661.418248:0:6519:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788305661.418268:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1875174015274112:12345-0@lo:400:kworker.0 Request processed in 23us (1202us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305661.418300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788305661.418330:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274368 00000100:00100000:3.0:1788305661.418335:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274368 00000100:00100000:3.0:1788305661.418368:0:8758:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274752 00000100:00100000:3.0:1788305661.418371:0:8758:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274752 00000100:00100000:3.0:1788305661.418394:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305661.418401:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015274368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.418435:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015274368:12345-0@lo:400:kworker.0 Request processed in 35us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305661.418441:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305661.418453:0:8758:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788305661.418459:0:8758:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015274752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.418487:0:8758:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015274752:12345-0@lo:400:kworker.0 Request processed in 29us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305661.418500:0:8758:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:3.0:1788305661.418736:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8891bfaa5500 x1875174015274240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305661.418756:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015274240:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.418774:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015274752:0@lo:400:kworker.0 00000100:00080000:3.0:1788305661.418787:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788305661.418793:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788305661.418797:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788305661.422342:0:7734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015273856 00000100:00100000:1.0:1788305661.422356:0:7734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015273856 00000100:00100000:1.0:1788305661.422421:0:7734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788305661.422432:0:7734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015273856:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788305661.422460:0:7734:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305661.422568:0:7734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bfaa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015273856:12345-0@lo:38:kworker.0 Request processed in 137us (5561us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305661.422576:0:7734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788305661.422599:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305661.422615:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015274880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305661.422669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305661.422740:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305661.422746:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305661.422750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015273856:0@lo:38:kworker.0 00000100:00100000:1.0:1788305661.422777:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015274880 00000100:00100000:1.0:1788305661.422781:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015274880 00000100:00100000:1.0:1788305661.422814:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305661.422821:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015274880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788305661.422854:0:8440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788305661.422896:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015274880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305661.422903:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788305661.422941:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015274880:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788305661.426408:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305661.426448:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788305661.426453:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305661.426603:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305661.426610:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8891bb050800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788305661.426615:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788305661.426635:0:3647:0:(import.c:65:import_set_state_nolock()) ffff8891bb050800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305661.426641:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 232 00000100:00080000:2.0:1788305661.426652:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8891bb050800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305661.426682:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1e680 x1875174015275136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305661.426714:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015273984:0@lo:400:kworker.0 00000100:00080000:2.0:1788305661.426732:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788305661.426736:0:3647:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788305661.426739:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788305661.426742:0:3647:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305661.426746:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 281 00000100:00080000:2.0:1788305661.426750:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88918448d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305661.426762:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1ce00 x1875174015275264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305661.426773:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015274496:0@lo:400:kworker.0 00000100:00100000:2.0:1788305661.426795:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015274368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305661.426819:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305661.426838:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015275008:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305661.426933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305661.427271:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015275136:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788305661.427335:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305661.427357:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015275264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788305661.427378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305661.427590:0:10100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275008 00000100:00100000:2.0:1788305661.427598:0:10100:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275008 00000100:00100000:2.0:1788305661.427668:0:10100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788305661.427679:0:10100:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015275008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305661.427719:0:10100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788305661.427775:0:10100:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015275008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305661.427783:0:10100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788305661.436560:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275136 00000100:00100000:0.0:1788305661.436582:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275136 00000100:00100000:0.0:1788305661.436658:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275264 00000100:00100000:0.0:1788305661.436661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275264 00000100:00100000:0.0:1788305661.436686:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788305661.436697:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275136:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788305661.436729:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305661.436843:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275136:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 147us (9507us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305661.436851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788305661.436871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788305661.436876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788305661.436886:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305661.436915:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 37us (9536us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788305661.436922:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788305661.441895:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015275008:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788305661.441962:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bb050800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305661.441969:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305661.441974:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015275136:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1788305661.441988:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305661.441992:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788305661.441995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015275264:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1788305661.451161:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305661.451179:0:3649:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 253 00000100:00080000:3.0:1788305661.451191:0:3649:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8891badee000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305661.451246:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb228e00 x1875174015275392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305661.451314:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015274112:0@lo:400:kworker.0 00010000:00080000:3.0:1788305661.451379:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8891bfaa4a80 x1875174015274624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305677 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305661.451392:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015274624:0@lo:400:kworker.0 00000100:00100000:3.0:1788305661.451456:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015275392:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788305661.451533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305661.451597:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275392 00000100:00100000:3.0:1788305661.451605:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275392 00000100:00100000:3.0:1788305661.451660:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788305661.451678:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275392:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788305661.451704:0:6520:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788305661.451749:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015275392:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 71us (216us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788305661.451756:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788305661.451786:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305661.451791:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305661.451794:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015275392:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1788305662.037666:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305663.068641:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305664.087649:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305664.414656:0:15364:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1788305664.438023:0:15364:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788305664.438964:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.438999:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.439006:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.439012:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.439646:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788305664.439654:0:15364:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788305664.439690:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305664.439695:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788305664.439701:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788305664.439786:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305664.439794:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.439802:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891a523ac00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305664.439806:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.439814:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305664.439821:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305664.439827:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305664.439830:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788305664.439833:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788305664.439876:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.439882:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305664.439907:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.439914:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523ac00/0x4a426866e605352f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053536 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.439928:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305664.439930:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305664.439931:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305664.439956:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015275520:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788305664.440807:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8891bb050800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788305664.440817:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305664.440819:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788305664.440824:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1788305664.441218:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305664.441794:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275520 00000100:00100000:3.0:1788305664.441804:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275520 00000100:00100000:3.0:1788305664.441852:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305664.441861:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891844c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1875174015275520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788305664.441868:0:6506:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305664 with bad export cookie 5350954098424623087 00010000:00010000:2.0:1788305664.443123:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.443142:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.443149:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.443156:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.443193:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305664.443201:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.443207:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444626:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305664.444637:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444648:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:0.0:1788305664.444652:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444663:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788305664.444671:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305664.444677:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788305664.444680:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788305664.444728:0:7461:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444736:0:7461:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788305664.444762:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444768:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea600/0x4a426866e605353d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053544 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305664.444783:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305664.444785:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305664.444786:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305664.444795:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305664.444820:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015275648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305664.444881:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305664.444933:0:7471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275648 00000100:00100000:0.0:1788305664.444941:0:7471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275648 00000100:00100000:0.0:1788305664.444978:0:7471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305664.444985:0:7471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875174015275648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788305664.444991:0:7471:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788305664 with bad export cookie 5350954098424623087 00000100:00100000:0.0:1788305664.445033:0:7471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3649:x1875174015275648:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (152us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788305664.445040:0:7471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788305664.445075:0:3649:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.155@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788305664.445080:0:3649:0:(import.c:65:import_set_state_nolock()) ffff889184446000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788305664.445084:0:3649:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.155@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:2.0:1788305664.445929:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.445943:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.445971:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305664.445981:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.445989:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.445995:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446001:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446015:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305664.446020:0:15364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446047:0:15364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446053:0:15364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446059:0:15364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.446071:0:15364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788305664.446075:0:15364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788305664.446080:0:15364:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788305664.446115:0:15364:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788305664.446120:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788305664.446125:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305664.446132:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788305664.446138:0:15364:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff88908273f000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305664.446143:0:15364:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8890820bd800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305664.446148:0:15364:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8891b91799b8) has exports, disconnecting them 00000020:00080000:2.0:1788305664.446152:0:15364:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff88908273f000), last request at 1788305661 00000020:00000080:2.0:1788305664.446159:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60533d1 00000100:00080000:2.0:1788305664.446176:0:15364:0:(import.c:65:import_set_state_nolock()) ffff889082739800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788305664.446221:0:15364:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff88908273f000): rc 0 00000020:00000080:2.0:1788305664.446224:0:15364:0:(genops.c:885:class_export_put()) final put ffff88908273f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788305664.446242:0:15364:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8890820bd800), last request at 1788305661 00000020:00000080:2.0:1788305664.446245:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60532ab 00000100:00080000:2.0:1788305664.446250:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8890820bb000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788305664.446257:0:15364:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8890820bd800): rc 0 00000020:00000080:2.0:1788305664.446267:0:15364:0:(genops.c:885:class_export_put()) final put ffff8890820bd800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788305664.446306:0:15364:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff94a3c1d23ae0 00000100:00080000:2.0:1788305664.446326:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305664.446335:0:15364:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff889083f1c700 x1875174015273472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788305674 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305664.446346:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:2.0:1788305664.447163:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788305664.447170:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8891badeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788305664.447321:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788305664.447325:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 3 00000004:00080000:2.0:1788305664.447336:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788305664.447406:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788305664.447427:0:15364:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788305664.447443:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788305664.447445:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:2.0:1788305664.447452:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788305664.447509:0:15364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788305664.447517:0:15364:0:(import.c:65:import_set_state_nolock()) ffff8891bf944000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788305664.447541:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8891b91799b8) has no exports 00010000:00010000:1.0:1788305664.447787:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788305664.447795:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.447805:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305664.447809:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.447835:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305664.447842:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305664.447848:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305664.447851:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788305664.447854:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:3.0:1788305664.453764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788305664.453841:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8890820bd800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788305664.453866:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889082739800 for lustre-MDT0001 00000020:00000080:3.0:1788305664.453871:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8890820bb000 for lustre-MDT0001 00000100:00100000:3.0:1788305664.453897:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015275776:0@lo:9:umount.0 00000100:00100000:3.0:1788305664.453975:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305664.454012:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015275904:0@lo:9:umount.0 00000100:00100000:3.0:1788305664.454035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305664.454079:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275776 00000100:00100000:3.0:1788305664.454087:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275776 00000100:00100000:3.0:1788305664.454144:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015275904 00000100:00100000:3.0:1788305664.454148:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015275904 00000100:00100000:3.0:1788305664.454175:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788305664.454199:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875174015275776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788305664.454229:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60532f8 00000100:00080000:3.0:1788305664.454237:0:8435:0:(import.c:65:import_set_state_nolock()) ffff8891b8f74800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305664.454272:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788305664.454458:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1875174015275776:12345-0@lo:9:umount.0 Request processed in 259us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305664.454467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788305664.454482:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305664.454488:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875174015275904:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788305664.454499:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605343a 00000100:00080000:3.0:1788305664.454504:0:8435:0:(import.c:65:import_set_state_nolock()) ffff88908273c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305664.454520:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788305664.454610:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3646:x1875174015275904:12345-0@lo:9:umount.0 Request processed in 108us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305664.454618:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788305664.454640:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305664.454643:0:6515:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788305664.454679:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788305664.454692:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788305664.454695:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305664.454698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015275776:0@lo:9:umount.0 00000100:00080000:3.0:1788305664.454709:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf944000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788305664.454712:0:3646:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788305664.454714:0:3646:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788305664.454716:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015275904:0@lo:9:umount.0 00000100:00100000:3.0:1788305664.454771:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891844c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3649:x1875174015275520:12345-0@lo:103:ldlm_bl.0 Request processed in 12909us (13554us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788305664.454779:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788305664.460382:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305664.460398:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.460411:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305664.460415:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305664.460426:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305664.460457:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305664.460463:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788305664.460465:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788305664.460469:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788305664.468392:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:0.0:1788305664.469565:0:3649:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.155@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788305664.469570:0:3649:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788305664.469581:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891bfaa6d80 x1875174015273728/t0(0) o400->MGC192.168.202.155@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788305677 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305664.469614:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e03800 x1875174015275520/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305680 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305664.469625:0:3649:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e00700 x1875174015275648/t0(0) o103->MGC192.168.202.155@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788305680 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305664.469856:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bfaa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:137eb269-2484-4047-a131-a502494b009f:3647:1875174015273728:0@lo:400:kworker.0 10000000:01000000:0.0:1788305664.469880:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788305664.469883:0:3649:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788305664.469885:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1788305664.469978:0:6508:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.469989:0:6508:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305664.470016:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470024:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183565600/0x4a426866e6053409 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e6053410 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470044:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305664.470046:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305664.470048:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305664.470086:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305664.470102:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:0:1875174015276032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305664.470498:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305664.470502:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305664.470503:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305664.470533:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470542:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305664.470547:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470573:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305664.470581:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305664.470586:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305664.470588:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788305664.470591:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788305664.470613:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:1.0:1788305664.470617:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470623:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181683a00/0x4a426866e60530f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60530f9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305664.470635:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305664.470637:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305664.470639:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305664.471495:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305664.471507:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788305664.471557:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:137eb269-2484-4047-a131-a502494b009f:0:1875174015276160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305664.471633:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305664.471642:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51400/0x4a426866e60537a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4a426866e60537ac expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305664.471655:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305664.471657:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305664.471659:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305664.471801:0:3649:0:(import.c:65:import_set_state_nolock()) ffff889184446000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305664.471808:0:3649:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 211 00000100:00080000:0.0:1788305664.471816:0:3649:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889184446000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305664.471840:0:3649:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00380 x1875174015276288/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305664.471897:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015275520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305664.471904:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015273472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305664.471928:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:137eb269-2484-4047-a131-a502494b009f:3649:1875174015275648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305664.472020:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015276288:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788305664.472079:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015276288 offset 0 length 520: 4 00000020:00080000:0.0:1788305664.477107:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8891b91799b8) has no exports 00000020:01000000:1.0:1788305664.540851:0:15364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891bb1a4300 - data ffff88919df14e58/ffff8891bb4e0000 00000020:01000000:1.0:1788305664.541047:0:15364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff88918a512780 - data ffff88919de24360/ffff8891baa0fc00 00000001:00000004:1.0:1788305664.567270:0:15364:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1788305664.613564:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305664.613573:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1788305664.613582:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788305664.616097:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788305664.616104:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 4 00000004:00080000:0.0:1788305664.616125:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305664.616128:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788305664.619212:0:8750:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788305664.619221:0:8750:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788305664.619238:0:8750:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788305664.624141:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788305664.624150:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1788305664.624172:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788305664.624175:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788305664.624873:0:9960:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788305664.624879:0:9960:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:1.0:1788305664.624907:0:9960:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788305664.627861:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053115 00000020:00000080:2.0:1788305664.627874:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b9175800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788305664.628480:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9175800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788305664.631897:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605312a 00000020:00000080:2.0:1788305664.631913:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b9173800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788305664.631933:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788305664.631939:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305664.631948:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788305664.631952:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff88918402b370) has no exports 00000004:01000000:2.0:1788305664.632118:0:15364:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788305664.632126:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053433 00000020:00000080:2.0:1788305664.632131:0:15364:0:(genops.c:885:class_export_put()) final put ffff889083181000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788305664.632136:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788305664.632139:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305664.632146:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788305664.632149:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8891bb4f0000) has no exports 00000020:00000080:2.0:1788305664.632154:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605342c 00000020:00000080:2.0:1788305664.632158:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891894cc000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788305664.632801:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9173800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788305664.632811:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff889083181000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788305664.632816:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891894cc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788305664.634546:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788305664.634553:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788305664.634558:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1788305664.634566:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788305664.634856:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305664.634898:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305664.634910:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788305664.634919:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60532f1 00000020:00000080:2.0:1788305664.634927:0:15364:0:(genops.c:885:class_export_put()) final put ffff88908273d800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788305664.634933:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788305664.634938:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305664.634943:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788305664.634946:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8891b917cd28) has no exports 00000020:00000080:2.0:1788305664.634952:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60532ea 00000020:00000080:2.0:1788305664.634955:0:15364:0:(genops.c:885:class_export_put()) final put ffff88908273c800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788305664.635314:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788305664.635318:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788305664.635321:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967299 gen 5 00000004:00080000:2.0:1788305664.635325:0:15364:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788305664.635326:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305664.635347:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305664.635352:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788305664.635363:0:15364:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788305664.635369:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605314d 00000020:00000080:2.0:1788305664.635373:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891baf59000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788305664.635377:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788305664.635381:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305664.635384:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788305664.635386:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff88918678b370) has no exports 00000020:00000080:2.0:1788305664.635390:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053146 00000020:00000080:2.0:1788305664.635393:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891baded800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788305664.636742:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bf944000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788305664.636756:0:38:0:(genops.c:885:class_export_put()) final put ffff8891b9153000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305664.636760:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9153000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788305664.636771:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305664.636851:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788305664.636857:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788305664.636873:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88908273e000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788305664.636877:0:38:0:(genops.c:885:class_export_put()) final put ffff8891bd788000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305664.636880:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd788000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788305664.636883:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305664.636913:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891baf59000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788305664.636917:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891baded800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788305664.639341:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788305664.639350:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305664.639365:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788305664.639375:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788305664.639427:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305664.639439:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305664.639476:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305664.639480:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305664.639493:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b8f76800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305664.639497:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8f76800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788305664.639505:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305664.639705:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053131 00000020:00000080:0.0:1788305664.639712:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b9177000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788305664.639717:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788305664.639720:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305664.639725:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788305664.639728:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8891b917b370) has no exports 00000020:00000080:0.0:1788305664.639748:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305664.639752:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788305664.639756:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053138 00000020:00000080:0.0:1788305664.639761:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b9171800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788305664.639770:0:15364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891894cd800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788305664.639773:0:15364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cd800 2 00000020:01000004:0.0:1788305664.639775:0:15364:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8891894cd800 from lustre-MDT0001 00000020:00000080:0.0:1788305664.639802:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305664.639805:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788305664.639808:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b9173000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788305664.639810:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9173000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788305664.639817:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788305664.639847:0:15364:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788305664.639850:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788305664.639852:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305664.639855:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305664.639861:0:15364:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8891baf59800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305664.639866:0:15364:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8891862719b8) has exports, disconnecting them 00000020:00080000:0.0:1788305664.639871:0:15364:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8891baf59800), last request at 1788305402 00000020:00000080:0.0:1788305664.639874:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605318c 00000020:00080000:0.0:1788305664.639886:0:15364:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891baf59800): rc 0 00000020:00000080:0.0:1788305664.639889:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891baf59800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788305664.640608:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891badeb000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788305664.640616:0:38:0:(genops.c:885:class_export_put()) final put ffff8891badec800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788305664.640618:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891badec800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788305664.640622:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788305664.640712:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9177000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788305664.640715:0:38:0:(genops.c:885:class_export_put()) final put ffff8891b9170800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788305664.640717:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9170800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788305664.640720:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788305664.640859:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b9171800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788305664.640864:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891baf59800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788305664.640887:0:15364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788305664.640891:0:15364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305664.640894:0:15364:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788305664.640899:0:15364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788305664.640915:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bb050800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788305664.641055:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305664.641062:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788305664.641065:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b90fe800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788305664.641068:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b90fe800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788305664.641072:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788305664.641102:0:15364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cd800 1 00000020:00000080:1.0:1788305664.641106:0:15364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60530c8 00000020:00000080:1.0:1788305664.641118:0:15364:0:(genops.c:885:class_export_put()) final put ffff88918448e000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788305664.641138:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788305664.641146:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918448e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788305664.641155:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305664.641158:0:15364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305664.641161:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff889186274d28) has no exports 00000020:00000080:1.0:1788305664.711769:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305664.711784:0:15364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788305664.711789:0:15364:0:(genops.c:885:class_export_put()) final put ffff8891b8d03000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788305664.711794:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8d03000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788305664.711806:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788305664.711926:0:15364:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8891b8d00000 00000020:01000000:1.0:1788305664.712099:0:15364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788305664.712103:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305664.712108:0:15364:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305664.712111:0:15364:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff88918678cd28) has no exports 00000100:00100000:1.0:1788305664.712205:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff889186204e00:6520] 1 exiting: rc = 0 00000100:00100000:0.0:1788305664.712411:0:10615:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff88908351d400:10615] 3 exiting: rc = 0 00000100:00100000:2.0:1788305664.712682:0:6521:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff88918691b200:6521] 2 exiting: rc = 0 00000100:00100000:3.0:1788305664.713247:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff88918a73aa00:6519] 0 exiting: rc = 1 00000100:00100000:1.0:1788305664.714091:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714100:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714106:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714110:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714116:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714121:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714127:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714131:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714136:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714141:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714146:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714162:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714168:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714174:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714179:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714184:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714190:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714195:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714200:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714206:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714211:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714219:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714224:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714243:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714248:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714253:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714259:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714264:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714270:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714608:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714615:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714621:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714637:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714645:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714651:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714657:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714662:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714667:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714672:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714676:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714681:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714686:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714690:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714695:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714700:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714705:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714710:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714715:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714720:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714725:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714730:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714734:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714739:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714744:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714750:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714755:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714760:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714765:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714777:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714781:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714786:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714792:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714796:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.714801:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.722167:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff88918691b400:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1788305664.722303:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff88918b677a00:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788305664.722657:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722666:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722673:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722678:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722685:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722692:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722698:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722703:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722708:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722713:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722718:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722723:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722730:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722736:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722741:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722747:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722766:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722771:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722776:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722782:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722787:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722792:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722797:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722802:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722807:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722811:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722816:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722821:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722825:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722831:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722836:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722841:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722845:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722850:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722855:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722860:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722865:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722888:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722896:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722900:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722905:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722909:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722915:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722921:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722926:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.722932:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723700:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723710:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723716:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723722:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723727:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723747:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723752:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723758:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723764:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723771:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723777:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723783:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723789:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723795:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723801:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723806:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723812:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.723817:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.725575:0:7734:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8891b9137600:7734] 2 exiting: rc = 0 00000100:00100000:1.0:1788305664.726537:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff889186396800:6524] 0 exiting: rc = 1 00000100:00100000:2.0:1788305664.727483:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff889186396e00:6525] 1 exiting: rc = 0 00000100:00100000:0.0:1788305664.727623:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727642:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727650:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727655:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727661:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727667:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727685:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727691:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727697:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727703:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727709:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727715:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727721:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727726:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727731:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727737:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727742:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727748:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727767:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727773:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727779:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727785:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727798:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727805:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727810:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727817:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727823:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727829:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727835:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727841:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727862:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727871:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727890:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727896:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727903:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727910:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727915:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727921:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727927:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.727933:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728175:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728183:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728205:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728214:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728220:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728226:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728234:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728240:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728246:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728252:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728258:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728264:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728271:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728311:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728332:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728340:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728346:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728433:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728440:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728445:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728452:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728458:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728464:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.728478:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.741642:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff88919e0bde00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1788305664.741734:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff88919e0bc000:6527] 1 exiting: rc = 0 00000100:00100000:2.0:1788305664.742260:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742268:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742295:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742302:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742308:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742314:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742319:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742324:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742330:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742336:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742341:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742347:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742352:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742499:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742504:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742509:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742515:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742520:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742525:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742530:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742536:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742541:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742546:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742551:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742556:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742561:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742567:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742571:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742576:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742582:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742587:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742602:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742609:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742615:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742620:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742638:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742644:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742650:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742656:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742661:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742666:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742672:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742677:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742682:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742687:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742692:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742697:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742702:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742708:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742713:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742719:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742724:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742729:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742734:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742739:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742745:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742751:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742756:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742761:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742767:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742771:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742776:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742781:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.742786:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.743332:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff88919e0bd000:6529] 1 exiting: rc = 0 00000100:00100000:3.0:1788305664.743764:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff88919e0bd400:6528] 0 exiting: rc = 1 00000100:00100000:2.0:1788305664.744421:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744431:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744437:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744442:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744447:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744452:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744470:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744476:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744482:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744488:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744493:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744499:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744505:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744510:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744515:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744521:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744526:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744531:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744536:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744542:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744547:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744553:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744558:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744563:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744568:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744574:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744579:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744585:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744590:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744606:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744612:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744617:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744623:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744628:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744633:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744638:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744643:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744649:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744656:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744662:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744667:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744681:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744686:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744692:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744697:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744702:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744707:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744712:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744716:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744721:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744727:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744732:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744736:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744741:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744746:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744751:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744756:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744761:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744766:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744771:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744776:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744781:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744786:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.744791:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.745674:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff88919e0bda00:6531] 1 exiting: rc = 0 00000100:00100000:3.0:1788305664.745826:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff88919e0bc400:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1788305664.746892:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746902:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746908:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746914:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746919:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746925:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.746930:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747136:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747145:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747151:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747156:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747160:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747179:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747184:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747189:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747194:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747199:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747204:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747209:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747213:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747217:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747222:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747227:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747232:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747236:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747241:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747246:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747252:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747257:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747262:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747267:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747271:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747336:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747342:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747347:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747352:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747464:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747469:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747475:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747479:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747485:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747490:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747495:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747501:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747506:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747511:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747516:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747530:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747535:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747540:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747545:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747550:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747555:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747560:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747565:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747571:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747576:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747581:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747586:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747591:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747606:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747611:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747616:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305664.747621:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305664.750831:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff88919e0bc200:6532] 0 exiting: rc = 1 00000100:00100000:1.0:1788305664.751759:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff88919e0bd800:6533] 1 exiting: rc = 0 00000100:00100000:1.0:1788305664.752192:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff889186238200:6534] 2 exiting: rc = 0 00000100:00100000:0.0:1788305664.752336:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752344:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752350:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752369:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752375:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752381:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752386:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752392:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752397:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752403:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752408:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752423:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752431:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752436:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752442:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752447:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752453:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752458:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752463:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752468:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752474:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752480:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752485:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752518:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752524:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752529:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752535:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752541:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752546:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752552:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752558:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752563:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752569:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752575:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752581:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752612:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752619:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752625:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752630:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752636:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752642:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752647:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752653:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752660:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752665:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752673:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752679:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752692:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752697:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752713:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752719:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752725:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752731:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752736:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752743:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752748:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752754:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752760:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752773:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752778:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752784:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752791:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752796:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305664.752808:0:15364:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788305664.756530:0:15364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305664.756542:0:15364:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788305664.756547:0:15364:0:(genops.c:885:class_export_put()) final put ffff889184de9000/MDS_uuid 00000020:00000080:0.0:1788305664.756551:0:15364:0:(genops.c:844:class_export_destroy()) destroying export ffff889184de9000/MDS_uuid for MDS 00000020:01000000:0.0:1788305664.756555:0:15364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788305664.756753:0:15364:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1788305665.126895:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305666.133486:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305666.518995:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305666.519005:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305666.519008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305666.519012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305666.519016:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305666.519024:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 491 00000100:00080000:0.0:1788305666.519030:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305666.519036:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8891badee000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305666.519085:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e02d80 x1875174015276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305666.519134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305666.519138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788305666.519140:0:8:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305666.519143:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 491 00000100:00080000:0.0:1788305666.519146:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305666.519150:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88918448d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305666.519170:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00700 x1875174015276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305666.519233:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015276544:0@lo:400:kworker.0 00000400:00000100:2.0:1788305666.519333:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015276544 offset 0 length 224: 4 00000100:00100000:2.0:1788305666.519396:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305666.519402:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015276800:0@lo:400:kworker.0 00000400:00000100:2.0:1788305666.519420:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015276800 offset 0 length 224: 4 00000100:00100000:3.0:1788305666.519640:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015276416:0@lo:38:kworker.0 00000400:00000100:3.0:1788305666.519663:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015276416 offset 0 length 520: 4 00000100:00100000:3.0:1788305666.519675:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015276672:0@lo:38:kworker.0 00000400:00000100:3.0:1788305666.519687:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015276672 offset 0 length 520: 4 00010000:00010000:1.0:1788305667.158105:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305668.182421:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788305669.027523:0:15565:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1788305669.045936:0:15565:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788305669.045997:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305669.046010:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305669.046017:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305669.046024:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305669.046058:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788305669.046064:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788305669.046088:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305669.046100:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e02d80 x1875174015276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305681 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305669.046116:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305669.046137:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788305669.046143:0:15565:0:(import.c:65:import_set_state_nolock()) ffff8891badee000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788305669.046148:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788305669.046152:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e02d80 x1875174015276416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305681 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305669.046159:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305669.046162:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1788305669.046885:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015276416:0@lo:38:kworker.0 00000100:00080000:1.0:1788305669.049272:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:2.0:1788305669.049544:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305669.049564:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305669.049577:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebc00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:2.0:1788305669.049582:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305669.049610:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788305669.049617:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305669.049623:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788305669.049626:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788305669.049629:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788305669.049645:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:2.0:1788305669.049649:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305669.049655:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3ebc00/0x4a426866e6053513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605351a expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305669.049667:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305669.049669:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305669.049670:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305669.050021:0:15565:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e02a00 x1875174015276544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305682 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305669.050124:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788305669.050132:0:15565:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788305669.050158:0:15565:0:(import.c:65:import_set_state_nolock()) ffff8891894c8800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788305669.050214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015276928:0@lo:39:umount.0 00000400:00000100:0.0:1788305669.050268:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015276928 offset 0 length 224: 4 00000100:00100000:2.0:1788305669.050700:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015276544:0@lo:400:kworker.0 00010000:00010000:2.0:1788305669.209328:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305669.525796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305669.525805:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305669.525807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305669.525810:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305669.525908:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305669.525932:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015277056:0@lo:400:kworker.0 00000400:00000100:1.0:1788305669.525987:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277056 offset 0 length 224: 4 00000001:00100000:0.0:1788305670.104350:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788305670.104359:0:9516:0:(genops.c:885:class_export_put()) final put ffff88908273a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788305670.104434:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000001:00100000:2.0:1788305670.104463:0:8431:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788305670.104466:0:8431:0:(genops.c:885:class_export_put()) final put ffff8891b8f71000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788305670.104498:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88908273c000 for lustre-OST0001 00000020:00000080:3.0:1788305670.104504:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891b8f71000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788305670.104525:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891b8f74800 for lustre-OST0000 00010000:00010000:1.0:1788305670.241087:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305671.254594:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305671.573435:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305671.573445:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305671.573448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305671.573452:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305671.573618:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305671.573650:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015277184:0@lo:400:kworker.0 00000400:00000100:2.0:1788305671.573708:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277184 offset 0 length 224: 4 00010000:00010000:2.0:1788305672.277552:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305673.301630:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305674.197541:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305664/real 1788305664] req@ffff8891b8e00380 x1875174015276288/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305674.197579:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b8e00380 x1875174015276288/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788305674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305674.197603:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889184446000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305674.197626:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788305674.197630:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015276288:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1788305674.197732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305674.197738:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788305674.197742:0:8:0:(import.c:65:import_set_state_nolock()) ffff889184446000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305674.197746:0:8:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1788305674.197752:0:8:0:(import.c:589:import_select_connection()) MGC192.168.202.155@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788305674.197757:0:8:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889184446000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305674.197785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00000 x1875174015277312/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305674.197817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788305674.197820:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305674.197885:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015277440:0@lo:400:kworker.0 00000400:00000100:2.0:1788305674.197937:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277440 offset 0 length 224: 4 00000100:00100000:3.0:1788305674.198021:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015277312:0@lo:250:kworker.0 00000400:00000100:3.0:1788305674.198037:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875174015277312 offset 0 length 520: 4 00010000:00010000:1.0:1788305674.326921:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305675.349535:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305676.373570:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305677.402698:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305678.421618:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305679.317743:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305669/real 1788305669] req@ffff889184db5180 x1875174015276928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305679 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305679.317778:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889184db5180 x1875174015276928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305679 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305679.317800:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894c8800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788305679.317837:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015276928:0@lo:39:umount.0 00000100:00080000:1.0:1788305679.318034:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788305679.318039:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788305679.318043:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788305679.319101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305679.319108:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305679.319111:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788305679.319115:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305679.319233:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015277568:0@lo:400:kworker.0 00000400:00000100:2.0:1788305679.319322:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277568 offset 0 length 224: 4 00010000:00010000:1.0:1788305679.319481:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319494:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319514:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319522:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319536:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305679.319543:0:15565:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319550:0:15565:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319556:0:15565:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319563:0:15565:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319579:0:15565:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788305679.319583:0:15565:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788305679.319608:0:15565:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788305679.319611:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:1.0:1788305679.319623:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305679.319629:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319636:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eac00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305679.319640:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319654:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305679.319661:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305679.319667:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305679.319670:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788305679.319672:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788305679.319685:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:1.0:1788305679.319689:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319695:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eac00/0x4a426866e6053521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6053528 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319709:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305679.319712:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319717:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51600 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305679.319720:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319726:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305679.319732:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305679.319746:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788305679.319748:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788305679.319750:0:6508:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788305679.319756:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:1.0:1788305679.319759:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319765:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e6053797 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605379e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305679.319773:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305679.319775:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305679.319776:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305679.319787:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305679.319794:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305679.319798:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8891bb4f3370) has no exports 00000020:00080000:1.0:1788305679.319824:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8891bb4f3370) has no exports 00010000:00010000:0.0:1788305679.320304:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788305679.322066:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891bb1a4b40 - data ffff88919df15000/ffff8891bb34e800 00000020:01000000:1.0:1788305679.322237:0:15565:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891baf991e0 - data ffff889081c13000/ffff8891a7f83000 00100000:10000000:1.0:1788305679.336068:0:15565:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788305679.348387:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6053265 00000020:00000080:0.0:1788305679.348403:0:15565:0:(genops.c:885:class_export_put()) final put ffff8890820be800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788305679.348422:0:15565:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891b9152800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788305679.348427:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891b9152800 2 00000020:01000004:0.0:1788305679.348430:0:15565:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8891b9152800 from lustre-OST0000 00000020:00000080:0.0:1788305679.348457:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305679.348477:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788305679.348481:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891badef000/lustre-OST0000_UUID 00000020:00000080:0.0:1788305679.348484:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8891badef000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788305679.348491:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788305679.348557:0:15565:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788305679.348562:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788305679.348566:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305679.348570:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305679.348577:0:15565:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8891bb052800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305679.348583:0:15565:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff889186223370) has exports, disconnecting them 00000020:00080000:0.0:1788305679.348587:0:15565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8891bb052800), last request at 1788305423 00000020:00000080:0.0:1788305679.348592:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605328f 00000020:00080000:0.0:1788305679.348602:0:15565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bb052800): rc 0 00000020:00000080:0.0:1788305679.348607:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891bb052800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305679.349406:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8890820be800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305679.349422:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb052800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788305679.353695:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788305679.353705:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788305679.353710:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788305679.353718:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788305679.353927:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788305679.353937:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788305679.353945:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788305679.353952:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305679.353957:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788305679.353964:0:15565:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8891bb054000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788305679.353971:0:15565:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff889186220000) has exports, disconnecting them 00000020:00080000:2.0:1788305679.353975:0:15565:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8891bb054000), last request at 1788305423 00000020:00000080:2.0:1788305679.353979:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60532a4 00000020:00080000:2.0:1788305679.353996:0:15565:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bb054000): rc 0 00000020:00000080:2.0:1788305679.354003:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891bb054000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788305679.354346:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891badee000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788305679.354354:0:38:0:(genops.c:885:class_export_put()) final put ffff88918448b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788305679.354357:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff88918448b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788305679.354363:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788305679.354427:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb054000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788305679.356440:0:15565:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788305679.356449:0:15565:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788305679.356453:0:15565:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788305679.356471:0:15565:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305679.356499:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891894c8800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788305679.356664:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305679.356672:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788305679.356678:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891bb057800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788305679.356681:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb057800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788305679.356687:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788305679.356745:0:15565:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891b9152800 1 00000020:00000080:3.0:1788305679.356752:0:15565:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605322d 00000020:00000080:3.0:1788305679.356757:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891baf5f800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788305679.356767:0:15565:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788305679.356774:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8891baf5f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788305679.356784:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788305679.356788:0:15565:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788305679.356792:0:15565:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8891b8fa0000) has no exports 00010000:00010000:3.0:1788305679.446727:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788305679.457053:0:15565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788305679.457068:0:15565:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788305679.457083:0:15565:0:(genops.c:885:class_export_put()) final put ffff8891bb1b8800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788305679.457088:0:15565:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bb1b8800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788305679.457100:0:15565:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788305679.457430:0:15565:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8891bb1bf800 00000020:02000400:3.0:1788305679.457492:0:15565:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788305680.469691:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305681.370721:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305666/real 1788305666] req@ffff8891b8e00700 x1875174015276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788305681 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305681.370755:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b8e00700 x1875174015276672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788305681 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305681.371373:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305681.371405:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305681.371410:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015276672:0@lo:38:kworker.0 00000100:00080000:2.0:1788305681.371730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305681.371740:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305681.371743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305681.371747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788305681.371752:0:8:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305681.371777:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788305681.371784:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788305681.371793:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff88918448d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305681.371844:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1ed80 x1875174015277696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305681.371965:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305681.371988:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015277824:0@lo:400:kworker.0 00000400:00000100:2.0:1788305681.372065:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277824 offset 0 length 224: 4 00000100:00100000:0.0:1788305681.373350:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015277696:0@lo:38:kworker.0 00000400:00000100:0.0:1788305681.373404:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277696 offset 0 length 520: 4 00010000:00010000:1.0:1788305681.495475:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788305682.325488:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305666/real 1788305666] req@ffff8891b8e03800 x1875174015276800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305682 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305682.338930:0:3649:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8891b8e03800 x1875174015276800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788305682 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305682.338945:0:3649:0:(import.c:65:import_set_state_nolock()) ffff8891bd78d000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788305682.338950:0:3649:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788305682.343770:0:3649:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:1.0:1788305682.343879:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015276800:0@lo:400:kworker.0 00000100:00080000:2.0:1788305682.343961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305682.343967:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 137eb269-2484-4047-a131-a502494b009f->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305682.343970:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305682.343973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305682.343975:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788305682.343978:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788305682.343981:0:38:0:(import.c:65:import_set_state_nolock()) ffff8891bd78d000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305682.343987:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 281 00000100:00080000:2.0:1788305682.343996:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8891bd78d000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305682.344036:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1c000 x1875174015277952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305682.344091:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015277952:0@lo:38:kworker.0 00000400:00000100:0.0:1788305682.344147:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875174015277952 offset 0 length 520: 4 00010000:00010000:0.0:1788305682.526202:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305683.542437:0:15365:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788305683.875635:0:15767:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1788305683.906675:0:15767:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788305683.906780:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.906798:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.906806:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.906835:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.906860:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788305683.906868:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788305683.906908:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305683.906925:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1ed80 x1875174015277696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305701 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.906949:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788305683.906959:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788305683.906967:0:15767:0:(import.c:65:import_set_state_nolock()) ffff88918448d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788305683.906974:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305683.906978:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1ed80 x1875174015277696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305701 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.906986:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788305683.906990:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:2.0:1788305683.907160:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015277696:0@lo:38:kworker.0 00010000:00010000:3.0:1788305683.909128:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305683.909147:0:7461:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305683.909162:0:7461:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305683.909167:0:7461:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305683.909191:0:7461:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305683.909199:0:7461:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305683.909205:0:7461:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305683.909208:0:7461:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788305683.909212:0:7461:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788305683.909238:0:7461:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:3.0:1788305683.909242:0:7461:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305683.909249:0:7461:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3eba00/0x4a426866e60534f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60534fe expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305683.909331:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305683.909334:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305683.909336:0:7461:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305683.909791:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788305683.909808:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e03b80 x1875174015277056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305685 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909902:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e00a80 x1875174015277184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305687 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909925:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e01180 x1875174015277440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305690 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909945:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891bb22b100 x1875174015277568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305695 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909961:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1d180 x1875174015277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305697 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909983:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1c000 x1875174015277952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305692 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.909996:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788305683.910004:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788305683.910013:0:15767:0:(import.c:65:import_set_state_nolock()) ffff8891bd78d000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788305683.910020:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788305683.910024:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e03b80 x1875174015277056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305685 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305683.910096:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3647:1875174015277184:0@lo:400:kworker.0 00000100:00100000:3.0:1788305683.910147:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015277440:0@lo:400:kworker.0 00000100:00100000:1.0:1788305683.911436:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015277056:0@lo:400:kworker.0 00000100:00100000:0.0:1788305683.911911:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e00a80 x1875174015277184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305687 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.911925:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e01180 x1875174015277440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305690 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.911936:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891bb22b100 x1875174015277568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305695 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.911946:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1d180 x1875174015277824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305697 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.911955:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff889083f1c000 x1875174015277952/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788305692 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305683.911965:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788305683.912449:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015277568:0@lo:400:kworker.0 00000100:00100000:2.0:1788305683.912546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015277952:0@lo:38:kworker.0 00000100:00100000:1.0:1788305683.912824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015277824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305683.912969:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788305683.921873:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.921902:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.921911:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.921940:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.922033:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305683.922043:0:15767:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.922050:0:15767:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.922057:0:15767:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305683.922063:0:15767:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931512:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305683.931533:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931581:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305683.931586:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931597:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305683.931605:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305683.931611:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788305683.931615:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788305683.931635:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:1.0:1788305683.931639:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931647:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183564e00/0x4a426866e6053505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605350c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931674:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305683.931678:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931683:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305683.931686:0:6508:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931692:0:6508:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305683.931706:0:6508:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305683.931712:0:6508:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788305683.931714:0:6508:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788305683.931720:0:6508:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:1.0:1788305683.931722:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305683.931730:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305683.931732:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305683.931735:0:6508:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305683.932176:0:15767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788305683.932196:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891bb3ea200/0x4a426866e6053789 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e6053790 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305683.932217:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788305683.932224:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788305683.932227:0:15767:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788305683.932310:0:15767:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788305683.932317:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788305683.934862:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788305683.934887:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788305683.934895:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff889186224d28) has no exports 00000020:00080000:2.0:1788305683.934937:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff889186224d28) has no exports 00000020:01000000:2.0:1788305683.936973:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8891bb1a43c0 - data ffff88919def25e8/ffff8891bb34d000 00000020:01000000:2.0:1788305683.937193:0:15767:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff889083520ba0 - data ffff88919def3438/ffff889083698000 00010000:00010000:3.0:1788305683.938500:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788305683.956776:0:15767:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788305683.964739:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605338b 00000020:00000080:3.0:1788305683.964759:0:15767:0:(genops.c:885:class_export_put()) final put ffff889083180000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788305683.964786:0:15767:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889082750000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788305683.964791:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889082750000 2 00000020:01000004:3.0:1788305683.964798:0:15767:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff889082750000 from lustre-OST0001 00000020:00000080:3.0:1788305683.964834:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305683.964881:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889083180000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788305683.965098:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788305683.965103:0:15767:0:(genops.c:885:class_export_put()) final put ffff889083182000/lustre-OST0001_UUID 00000020:00000080:3.0:1788305683.965105:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff889083182000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788305683.965113:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788305683.965631:0:15767:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 137eb269-2484-4047-a131-a502494b009f->MGS 00010000:00010000:3.0:1788305683.965654:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181682a00/0x4a426866e60530e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305683.965671:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181682a00/0x4a426866e60530e4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305683.965679:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788305683.965682:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788305683.965686:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788305683.965709:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:3.0:1788305683.965716:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181682a00/0x4a426866e60530e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e60530eb expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305683.966307:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305683.966315:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305683.966321:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788305683.966324:0:15767:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788305683.966326:0:15767:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788305683.966341:0:15767:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff889184446000 00010000:00010000:3.0:1788305683.966344:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891a523bc00/0x4a426866e6053567 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4a426866e605356e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788305683.966363:0:15767:0:(import.c:65:import_set_state_nolock()) ffff889184446000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788305683.966369:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788305683.966372:0:15767:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788305683.966374:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788305683.966379:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788305683.966394:0:15767:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8891b8e00000 x1875174015277312/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788305689 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788305683.966416:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788305683.966429:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:0.0:1788305683.968437:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:137eb269-2484-4047-a131-a502494b009f:3646:1875174015277312:0@lo:250:kworker.0 10000000:01000000:1.0:1788305683.968575:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788305683.968593:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6052fe1 00000020:00000080:1.0:1788305683.968604:0:15767:0:(genops.c:885:class_export_put()) final put ffff88918c9a4000/137eb269-2484-4047-a131-a502494b009f 00000020:01000000:1.0:1788305683.968627:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.155@tcp (flags='') 00000020:00000080:1.0:1788305683.968641:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305683.968651:0:15767:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.155@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788305683.968655:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff889186788000) has no exports 10000000:01000000:1.0:1788305683.968681:0:6516:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788305683.968770:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.155@tcp: client import never connected 00000100:00080000:1.0:1788305683.968774:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788305683.968778:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788305683.968781:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788305683.968783:0:15767:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788305683.968826:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305683.968833:0:15767:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.155@tcp (uuid 137eb269-2484-4047-a131-a502494b009f) 00000020:01000000:1.0:1788305683.968841:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788305683.968844:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305683.968848:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788305683.968869:0:15767:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8891bd789800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788305683.968875:0:15767:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8890833dcd28) has exports, disconnecting them 00000020:00080000:1.0:1788305683.968879:0:15767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8891bd789800), last request at 1788305451 00000020:00000080:1.0:1788305683.968884:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60533b5 00000020:00080000:1.0:1788305683.968896:0:15767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bd789800): rc 0 00000020:00000080:1.0:1788305683.968901:0:15767:0:(genops.c:885:class_export_put()) final put ffff8891bd789800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788305683.970606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88918c9a4000/137eb269-2484-4047-a131-a502494b009f for MGC192.168.202.155@tcp 00000020:00000080:0.0:1788305683.970650:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff889184446000 for MGC192.168.202.155@tcp 00000020:00000080:0.0:1788305683.970660:0:8:0:(genops.c:885:class_export_put()) final put ffff88918c9a0800/137eb269-2484-4047-a131-a502494b009f 00000020:00000080:0.0:1788305683.970664:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88918c9a0800/137eb269-2484-4047-a131-a502494b009f for MGC192.168.202.155@tcp 00000020:01000000:0.0:1788305683.970670:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.155@tcp (137eb269-2484-4047-a131-a502494b009f) 00000020:00000080:0.0:1788305683.971031:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd789800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788305683.971443:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788305683.971449:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788305683.971455:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788305683.971462:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788305683.971658:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305683.971668:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788305683.971677:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788305683.971683:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305683.971688:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788305683.971698:0:15767:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8891bd78a800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788305683.971705:0:15767:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8890833d99b8) has exports, disconnecting them 00000020:00080000:0.0:1788305683.971710:0:15767:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8891bd78a800), last request at 1788305451 00000020:00000080:0.0:1788305683.971715:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e60533ca 00000020:00080000:0.0:1788305683.971733:0:15767:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8891bd78a800): rc 0 00000020:00000080:0.0:1788305683.971739:0:15767:0:(genops.c:885:class_export_put()) final put ffff8891bd78a800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788305683.973373:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff88918448d000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788305683.973391:0:8:0:(genops.c:885:class_export_put()) final put ffff88908273b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788305683.973395:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff88908273b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788305683.973406:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788305683.973504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd78a800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788305683.979366:0:15767:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788305683.979381:0:15767:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788305683.979402:0:15767:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788305683.979413:0:15767:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788305683.979472:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8891bd78d000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788305683.979544:0:15365:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788305683.979700:0:7461:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788305684.020671:0:6508:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788305684.021262:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788305684.021555:0:13738:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8891b8efea00:13738] 2 exiting: rc = 0 00000100:00100000:1.0:1788305684.021641:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff88918c9a9a00:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1788305684.022381:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff88919e0c1000:6503] 1 exiting: rc = 0 00000100:00100000:3.0:1788305684.022528:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305684.022870:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8891863bd000:6506] 2 exiting: rc = 0 00000100:00100000:0.0:1788305684.023142:0:7471:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8891b9107000:7471] 3 exiting: rc = 0 00000100:00100000:1.0:1788305684.023334:0:10341:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8890827cf800:10341] 4 exiting: rc = 0 00000100:00100000:1.0:1788305684.023633:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff88918caf5000:6504] 0 exiting: rc = 1 00000100:00100000:3.0:1788305684.024388:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff88919e0c1c00:6505] 1 exiting: rc = 0 00000100:00100000:0.0:1788305684.024545:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024556:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024564:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024571:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024579:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024587:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024609:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024617:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024624:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024630:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024637:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024643:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024650:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024658:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024664:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024669:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024676:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024683:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024690:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024696:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024703:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024709:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024715:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024720:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024726:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024731:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024737:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024742:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024748:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024754:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024759:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024764:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024770:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024775:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024780:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024785:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024789:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024794:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024800:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024805:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024811:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024825:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024830:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024835:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024840:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024845:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024850:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024857:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024863:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024869:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024874:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024879:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024987:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.024998:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025003:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025009:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025015:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025021:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025027:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025033:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025039:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025045:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025050:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.025056:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788305684.026612:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788305684.026629:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788305684.026638:0:15767:0:(genops.c:885:class_export_put()) final put ffff8891bd78b000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788305684.026644:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8891bd78b000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788305684.026653:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788305684.026730:0:15767:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889082750000 1 00000020:00000080:0.0:1788305684.026739:0:15767:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e605335a 00000020:00000080:0.0:1788305684.026748:0:15767:0:(genops.c:885:class_export_put()) final put ffff889082756800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788305684.026948:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788305684.026954:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788305684.026961:0:15767:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788305684.026976:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8891b8fa19b8) has no exports 00000020:00000080:3.0:1788305684.033533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff889082756800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788305684.077335:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305684.077355:0:15767:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788305684.077363:0:15767:0:(genops.c:885:class_export_put()) final put ffff889082753800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788305684.077370:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff889082753800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788305684.077379:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788305684.077829:0:15767:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff889082757000 00000020:01000000:1.0:1788305684.077856:0:15767:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788305684.077861:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788305684.077866:0:15767:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788305684.077870:0:15767:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8891bb4f19b8) has no exports 00000020:00000080:1.0:1788305684.077904:0:15767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788305684.077909:0:15767:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788305684.077913:0:15767:0:(genops.c:885:class_export_put()) final put ffff8891baf5c000/OSS_uuid 00000020:00000080:1.0:1788305684.077915:0:15767:0:(genops.c:844:class_export_destroy()) destroying export ffff8891baf5c000/OSS_uuid for OSS 00000020:01000000:1.0:1788305684.077919:0:15767:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788305684.079003:0:6515:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788305684.079233:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8891b9137c00:8435] 0 exiting: rc = 1 00000100:00100000:3.0:1788305684.079311:0:8758:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff88908232be00:8758] 3 exiting: rc = 0 00000100:00100000:3.0:1788305684.079365:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8891bb098800:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1788305684.079411:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff88918622e000:8437] 2 exiting: rc = 0 00000100:00100000:2.0:1788305684.086906:0:14680:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff88908310c400:14680] 4 exiting: rc = 0 00000100:00100000:1.0:1788305684.087214:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087226:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087234:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087240:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087247:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087269:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087309:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087320:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087327:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087336:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087343:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087351:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087364:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087380:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087392:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087400:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087406:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087413:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087430:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087437:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087443:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087449:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087455:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087461:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087467:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087473:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087479:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087485:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087491:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087498:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087505:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087512:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087518:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087525:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087531:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087538:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087544:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087549:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087556:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087562:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087575:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087581:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087588:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087595:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087601:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087608:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087614:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087622:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087628:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087634:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087641:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087647:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087653:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087659:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087664:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087670:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087676:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087682:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087687:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087693:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087698:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087704:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087709:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.087715:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.088771:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8891a526e200:8439] 0 exiting: rc = 1 00000100:00100000:0.0:1788305684.088968:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8891bb0a2400:8440] 1 exiting: rc = 0 00000100:00100000:3.0:1788305684.089141:0:10100:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8891bb172c00:10100] 2 exiting: rc = 0 00000100:00100000:0.0:1788305684.093683:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093703:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093710:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093716:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093721:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093727:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093733:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093739:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093745:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093752:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093758:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093764:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093770:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093778:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093784:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093791:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093797:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093803:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093808:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093813:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093818:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093824:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093830:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093836:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093841:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093847:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093852:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093858:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093863:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093869:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093874:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093880:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093886:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093913:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093919:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093924:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093930:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093934:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093940:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093945:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093950:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093955:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093960:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093965:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093970:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093976:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093982:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093988:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093993:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.093999:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094004:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094009:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094016:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094021:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094027:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094032:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094038:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094043:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094049:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094055:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094061:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094067:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094072:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.094078:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.095267:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8891bb0dba00:8442] 1 exiting: rc = 0 00000100:00100000:3.0:1788305684.095981:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8891bb0db200:8441] 0 exiting: rc = 1 00000100:00100000:2.0:1788305684.096469:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8891bb0db400:8443] 2 exiting: rc = 0 00000100:00100000:0.0:1788305684.097948:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.097961:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.097968:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.097996:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098002:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098009:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098016:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098022:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098028:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098035:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098041:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098047:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098054:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098060:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098066:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098071:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098077:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098083:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098089:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098095:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098101:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098108:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098133:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098140:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098146:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098152:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098158:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098163:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098169:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098176:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098183:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098189:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098196:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098203:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098209:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098215:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098221:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098227:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098241:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098247:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098253:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098260:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098265:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098271:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098315:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098323:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098346:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098354:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098361:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098368:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098374:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098380:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098386:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098393:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098400:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098407:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098413:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098440:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098466:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098482:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098489:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098496:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098502:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788305684.098516:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788305684.154536:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8891bb0da600:8444] 0 exiting: rc = 1 00000100:00100000:0.0:1788305684.161215:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8891bb0db000:8445] 1 exiting: rc = 0 00000100:00100000:1.0:1788305684.164992:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165007:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165013:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165019:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165024:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165030:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165036:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165042:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165047:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165053:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165084:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165092:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165098:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165105:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165111:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165116:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165122:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165129:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165135:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165140:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165146:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165153:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165159:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165164:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165170:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165176:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165182:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165188:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165193:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165199:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165205:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165210:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165215:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165222:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165228:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165234:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165239:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165245:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165250:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165255:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165260:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165266:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165483:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165494:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165500:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165515:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165522:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165528:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165533:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165540:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165547:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165553:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165559:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165566:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165572:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165588:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165596:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165602:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165607:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165612:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165617:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165623:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165629:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.165635:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788305684.168959:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8891bb0dac00:8446] 0 exiting: rc = 1 00000100:00100000:0.0:1788305684.169349:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8891bb0da800:8447] 1 exiting: rc = 0 00000100:00100000:1.0:1788305684.169520:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169531:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169545:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169582:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169591:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169598:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169605:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169612:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169618:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169625:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169631:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169638:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169644:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169652:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169658:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169680:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169705:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169711:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169718:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169725:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169731:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169737:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169744:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169751:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169757:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169766:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169772:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169794:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169801:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169807:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169814:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169820:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169826:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169833:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169839:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169846:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169853:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169859:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169866:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169887:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169895:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169901:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169908:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169914:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169921:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169927:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169933:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169941:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169948:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169956:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169964:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.169994:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170002:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170008:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170014:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170021:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170027:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170034:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170040:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170046:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170053:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170059:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170066:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788305684.170080:0:15767:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788305684.190145:0:15767:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788305705.564201:0:16532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788305718.590988:0:17131:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305718.591003:0:17131:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788305718.591005:0:17131:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788305718.591130:0:17131:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff889182f56000 00000020:01000004:3.0:1788305718.591147:0:17131:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788305718.591154:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788305718.591168:0:17131:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8891b8fa0000) 00000020:00000080:3.0:1788305718.591184:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788305718.739725:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788305718.751936:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.753914:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.756786:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.757767:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.758539:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.758830:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.759319:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.759602:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.759783:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.760174:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.760658:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.761263:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.761782:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.762530:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.762807:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.763153:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.763419:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.763715:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.763992:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.764363:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.765155:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.765519:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.766462:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.768035:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.768529:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.768789:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.769118:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.769469:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.769727:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.770122:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.770372:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788305718.770590:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.770800:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788305718.772245:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.772539:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.772785:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.773318:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.773710:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.773973:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.774394:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.774649:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.774880:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.775128:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788305718.775373:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.775895:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788305718.779986:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.785799:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.786487:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.786745:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.787316:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.787602:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1788305718.788024:0:17131:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:0.0:1788305718.788624:0:17131:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305718.788859:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788305718.788881:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305718.788903:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e605459e 00000020:01000004:0.0:1788305718.788910:0:17131:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788305718.788915:0:17131:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788305718.788921:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889182f56000 from MGS 00000020:01000004:0.0:1788305718.788926:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788305718.788936:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff889186224d28) 00000020:00000080:0.0:1788305718.788946:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788305718.789010:0:17131:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182f56000 from MGS, refs=2 00080000:01000000:0.0:1788305718.789015:0:17131:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788305718.789020:0:17131:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e60545ac 00000100:00100000:0.0:1788305718.789127:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788305718.789254:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788305718.789260:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788305718.794038:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788305718.794059:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788305718.796181:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305718.796407:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788305718.796413:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788305718.809497:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788305718.809511:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788305718.810228:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788305718.810237:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788305718.810888:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305718.810892:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305718.810894:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305718.811343:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305718.811345:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305718.811347:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305718.811818:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788305718.814120:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788305718.826852:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788305718.844069:0:17143:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788305718.844216:0:17131:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788305718.844336:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788305718.845156:0:17131:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788305718.845487:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305718.845645:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788305718.845651:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788305718.846703:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788305718.846712:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788305718.848445:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788305718.848456:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788305718.849829:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788305718.849853:0:17131:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.155@tcp' 00000020:01000004:2.0:1788305718.849855:0:17131:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788305718.849899:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.155@tcp (typ=mgc) 00000020:00000080:2.0:1788305718.849913:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.155@tcp (ffff8891bb4f4d28) 00000020:00000080:2.0:1788305718.849930:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788305718.850230:0:17131:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889083f77000@MGC192.168.202.155@tcp: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305718.850416:0:17131:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.155@tcp-0 is initialized 00000040:01000000:2.0:1788305718.850429:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788305718.850820:0:17148:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788305718.863156:0:17149:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788305718.863445:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.155@tcp (uuid 739dca1e-bd16-46de-8d05-a6337c8af843) 00000020:00000080:2.0:1788305718.863472:0:17131:0:(genops.c:1385:class_connect()) connect: client 739dca1e-bd16-46de-8d05-a6337c8af843, cookie 0x4a426866e60545ba 00000100:00080000:2.0:1788305718.863485:0:17131:0:(import.c:510:import_select_connection()) MGC192.168.202.155@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305718.863493:0:17131:0:(import.c:624:import_select_connection()) MGC192.168.202.155@tcp: import ffff889083f77000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305718.863529:0:17131:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1c000 x1875174015278080/t0(0) o250->MGC192.168.202.155@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305718.863553:0:17131:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 739dca1e-bd16-46de-8d05-a6337c8af843->MGS 00000020:01000004:2.0:1788305718.863622:0:17131:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788305718.863628:0:17131:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788305718.863645:0:17131:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8891bb4f19b8) 00000020:00000080:2.0:1788305718.863658:0:17131:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788305718.866037:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015278080:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788305718.866138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305718.867560:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278080 00000100:00100000:0.0:1788305718.867573:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278080 00000100:00100000:0.0:1788305718.867618:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305718.867626:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3646:x1875174015278080:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788305718.867653:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 739dca1e-bd16-46de-8d05-a6337c8af843@0@lo t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1788305718.867691:0:17145:0:(genops.c:1385:class_connect()) connect: client 739dca1e-bd16-46de-8d05-a6337c8af843, cookie 0x4a426866e60545c8 00000100:00080000:0.0:1788305718.867856:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8891bb1bf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305718.867947:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+5:3646:x1875174015278080:12345-0@lo:250:mount.lustre.0 Request processed in 319us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305718.867955:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788305718.868204:0:3646:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.155@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788305718.868214:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.155@tcp: connect to target with instance 0 00000100:00080000:0.0:1788305718.868222:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.155@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788305718.868227:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788305718.868231:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889083f77000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788305718.868234:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788305718.868242:0:3646:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788305718.868249:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:739dca1e-bd16-46de-8d05-a6337c8af843:3646:1875174015278080:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788305718.887663:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305718.888522:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788305718.888532:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788305718.895970:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305718.896055:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788305718.897719:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788305718.897729:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788305718.903510:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305718.903697:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788305718.903703:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788305718.904691:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788305718.904700:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788305718.966946:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305718.967185:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788305718.967193:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788305718.971877:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788305718.971892:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788305718.973616:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305718.973777:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305718.973782:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788305718.974782:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305718.974792:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788305718.975524:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788305718.975711:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788305718.975718:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788305718.979320:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788305718.979336:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788305718.980203:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305718.986549:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788305718.986561:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788305718.987752:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788305718.987764:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788305719.030324:0:17131:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305719.030514:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788305719.030520:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788305719.034048:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788305719.034062:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788305719.035633:0:17131:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788305719.035646:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788305719.036906:0:17131:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788305719.036937:0:17131:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1788305719.036944:0:17131:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788305719.037049:0:17131:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788305719.037441:0:17131:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788305719.037446:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788305719.037448:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305719.037449:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305719.037450:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305719.037452:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305719.037453:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305719.037454:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305719.037455:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305719.037457:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305719.037458:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305719.037461:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788305719.037463:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305719.037465:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305719.037466:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305719.037467:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305719.037468:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305719.037469:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305719.037470:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305719.037471:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305719.037472:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305719.037474:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788305719.037502:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788305719.037522:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278208:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305719.037598:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305719.037726:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305719.043596:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278208 00000100:00100000:0.0:1788305719.043610:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278208 00000100:00100000:0.0:1788305719.043676:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788305719.043687:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+5:17131:x1875174015278208:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788305719.043752:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788305719.043755:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788305719.043758:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788305719.044531:0:17167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788305719.045555:0:17147:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788305719.047967:0:17168:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788305719.047974:0:17168:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788305719.047977:0:17168:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788305719.047979:0:17168:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788305719.049382:0:17168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788305719.049528:0:17147:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788305719.049544:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788305719.053459:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+5:17131:x1875174015278208:12345-0@lo:253:mount.lustre.0 Request processed in 9765us (15853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305719.053479:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305719.053595:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278208:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788305719.053611:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788305719.053629:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305719.053631:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788305719.053633:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305719.053634:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305719.053635:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305719.053636:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305719.053638:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305719.053639:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788305719.053641:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305719.053642:0:17131:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788305719.053661:0:17131:0:(tgt_mount.c:101:server_register_mount()) register mount ffff889182f56000 from lustre-MDT0000 10000000:01000000:1.0:1788305719.053694:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788305719.053697:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788305719.053702:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8891bb4f4d28 10000000:01000000:1.0:1788305719.053706:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305719.053714:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8891bb4f4d28 from 1 10000000:01000000:1.0:1788305719.053717:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788305719.053753:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.053764:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.053774:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305719.053794:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278336:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305719.053844:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305719.053885:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918ab2c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305719.054015:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278336 00000100:00100000:2.0:1788305719.054029:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278336 00000100:00100000:2.0:1788305719.054072:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305719.054082:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+5:17131:x1875174015278336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305719.054095:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305719.054118:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21a00/0x4a426866e60545d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60545cf expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.054141:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21a00/0x4a426866e60545d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60545cf expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.054153:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21a00/0x4a426866e60545d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60545cf expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.054162:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21a00, rc 0) 00000100:00100000:2.0:1788305719.054210:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+6:17131:x1875174015278336:12345-0@lo:101:mount.lustre.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305719.054217:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305719.054316:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305719.054331:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.054339:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305719.054413:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305719.054444:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.054473:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305719.054531:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278464 00000100:00100000:2.0:1788305719.054536:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278464 00000100:00100000:2.0:1788305719.054571:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305719.054579:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+6:17131:x1875174015278464:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305719.054678:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+6:17131:x1875174015278464:12345-0@lo:501:mount.lustre.0 Request processed in 99us (232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305719.054685:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305719.054915:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278464:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788305719.054948:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788305719.054970:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.054999:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305719.055008:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff889182f56000 10000000:01000000:0.0:1788305719.055012:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788305719.055016:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff889182f56000 10000000:01000000:0.0:1788305719.055018:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788305719.055021:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff889182f56000 from 1 10000000:01000000:0.0:1788305719.055024:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788305719.055044:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055052:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055061:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.055075:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305719.055115:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.055138:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918542f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305719.055317:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278592 00000100:00100000:2.0:1788305719.055322:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278592 00000100:00100000:2.0:1788305719.055358:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305719.055365:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+6:17131:x1875174015278592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305719.055385:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305719.055397:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21400/0x4a426866e60545e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60545dd expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.055413:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21400/0x4a426866e60545e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60545dd expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.055423:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21400/0x4a426866e60545e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60545dd expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.055432:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21400, rc 0) 00000100:00100000:2.0:1788305719.055470:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+7:17131:x1875174015278592:12345-0@lo:101:mount.lustre.0 Request processed in 106us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305719.055476:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305719.055548:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305719.055559:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055567:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305719.055588:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788305719.055605:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055611:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8600/0x4a426866e60545dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545e4 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305719.055617:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788305719.055620:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305719.055624:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff889182f56000 10000000:01000000:0.0:1788305719.055626:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788305719.055630:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788305719.055631:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788305719.055644:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055651:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.055659:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.055670:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278720:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305719.055695:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.055725:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918542f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.055782:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278720 00000100:00100000:3.0:1788305719.055786:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278720 00000100:00100000:3.0:1788305719.055818:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305719.055825:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+7:17131:x1875174015278720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305719.055842:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305719.055852:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518000/0x4a426866e60545f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60545eb expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.055866:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518000/0x4a426866e60545f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60545eb expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.055875:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518000/0x4a426866e60545f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60545eb expref: 8 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.055892:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518000, rc 0) 00000100:00100000:3.0:1788305719.055920:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+8:17131:x1875174015278720:12345-0@lo:101:mount.lustre.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.055926:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305719.056205:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305719.056216:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.056230:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.056310:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305719.056336:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.056354:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918542f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305719.056366:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278848 00000100:00100000:0.0:1788305719.056370:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278848 00000100:00100000:0.0:1788305719.056390:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305719.056396:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+8:17131:x1875174015278848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305719.056526:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+9:17131:x1875174015278848:12345-0@lo:501:mount.lustre.0 Request processed in 130us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305719.056533:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305719.056562:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305719.056590:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305719.056627:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.056639:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cb040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305719.056650:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015278976 00000100:00100000:0.0:1788305719.056653:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015278976 00000100:00100000:0.0:1788305719.056669:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305719.056674:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+9:17131:x1875174015278976:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305719.058265:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+9:17131:x1875174015278976:12345-0@lo:503:mount.lustre.0 Request processed in 1583us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.058317:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305719.058464:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015278976:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305719.059806:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17169:1875174015279104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305719.059878:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.059914:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918542fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.060333:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015279104 00000100:00100000:1.0:1788305719.060349:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015279104 00000100:00100000:1.0:1788305719.060401:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305719.060411:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+9:17169:x1875174015279104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305719.061264:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+9:17169:x1875174015279104:12345-0@lo:502:llog_process_th.0 Request processed in 850us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.061304:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305719.061312:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17169:1875174015279104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788305719.061345:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305719.061357:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.061360:0:17169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788305719.061366:0:17169:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788305719.061371:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305719.061385:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff889186220000) 00000020:00000080:0.0:1788305719.061402:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788305719.061406:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788305719.061484:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788305719.061491:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054600 00000020:00000080:0.0:1788305719.061683:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788305719.061687:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305719.061690:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.061692:0:17169:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788305719.061694:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305719.061697:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.061698:0:17169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788305719.061701:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305719.061707:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff889186223370) 00000020:00000080:0.0:1788305719.061715:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788305719.061718:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788305719.061720:0:17169:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788305719.061723:0:17169:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788305719.061729:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788305719.061763:0:17169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182f56000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788305719.061773:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8891862219b8) 00000020:00000080:0.0:1788305719.061779:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788305719.070813:0:17169:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788305719.070852:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054615 00000020:00000080:0.0:1788305719.071023:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788305719.071030:0:17169:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788305719.071034:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4a426866e605461c 00080000:01000000:0.0:1788305719.071040:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788305719.071046:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054623 00010000:00010000:3.0:1788305719.194550:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788305719.195191:0:17169:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788305719.195580:0:17169:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788305719.196395:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8891b8fa3370) 00000020:00000080:3.0:1788305719.196415:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788305719.196495:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788305719.196502:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054631 00000020:00000080:2.0:1788305719.203005:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788305719.216423:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4a426866e6054638 00000020:00000080:0.0:1788305719.220182:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788305719.220200:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305719.220207:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.220209:0:17169:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788305719.220212:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788305719.220215:0:17169:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788305719.220216:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305719.220218:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305719.220219:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788305719.220221:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.220222:0:17169:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788305719.220225:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305719.220229:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.220230:0:17169:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788305719.220235:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788305719.220303:0:17169:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788305719.220319:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305719.220322:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.220324:0:17169:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788305719.220326:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305719.220330:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.220331:0:17169:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788305719.220334:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788305719.220340:0:17169:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:0.0:1788305719.220368:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305719.220384:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff889186274d28) 00000020:00000080:0.0:1788305719.220400:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788305719.220405:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788305719.220467:0:17169:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788305719.220473:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788305719.220480:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054646 00010000:00080000:0.0:1788305719.220512:0:17169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891bf99f800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305719.227662:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788305719.231475:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305719.231489:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788305719.231523:0:17169:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788305719.231543:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e605464d 00000100:00080000:1.0:1788305719.231554:0:17169:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305719.231561:0:17169:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305719.231597:0:17169:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184db7100 x1875174015279232/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305719.231673:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279232:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305719.231761:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.231901:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015279232 00000100:00100000:3.0:1788305719.231908:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015279232 00000100:00100000:3.0:1788305719.231939:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305719.231947:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015279232:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788305719.231962:0:17156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788305719.233746:0:17169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788305719.233863:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305719.233869:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.233872:0:17169:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788305719.233875:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788305719.233878:0:17169:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788305719.233879:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305719.233880:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788305719.233881:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788305719.233883:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.233885:0:17169:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788305719.233886:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788305719.233891:0:17169:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788305719.233894:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.233895:0:17169:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788305719.233897:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305719.233912:0:17169:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:1.0:1788305719.233935:0:17169:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788305719.233937:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305719.233951:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8890833d8000) 00000020:00000080:1.0:1788305719.233969:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788305719.233973:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305719.234054:0:17169:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788305719.234061:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788305719.234067:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e605465b 00010000:00080000:1.0:1788305719.234109:0:17169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891844f9000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305719.234348:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788305719.236163:0:17169:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788305719.236470:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788305719.240579:0:17169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305719.243139:0:17169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788305719.250622:0:17169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788305719.260065:0:17175:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788305719.260075:0:17175:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788305719.261017:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788305719.261032:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788305719.261068:0:17169:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788305719.261088:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054662 00000100:00080000:0.0:1788305719.261115:0:17169:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305719.261122:0:17169:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891844f9000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305719.261158:0:17169:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00000 x1875174015279360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305719.261190:0:17169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788305719.261240:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305719.261246:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.261247:0:17169:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788305719.261251:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788305719.261253:0:17169:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788305719.261255:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305719.261257:0:17169:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305719.261258:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788305719.261260:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.261262:0:17169:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788305719.261264:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305719.261268:0:17169:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788305719.261271:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305719.261299:0:17169:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788305719.261303:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788305719.261315:0:17169:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:0.0:1788305719.261342:0:17169:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788305719.261345:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305719.261356:0:17169:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8891862719b8) 00000020:00000080:0.0:1788305719.261369:0:17169:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788305719.261374:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788305719.261435:0:17169:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788305719.261440:0:17169:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788305719.261446:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4a426866e6054670 00010000:00080000:0.0:1788305719.261476:0:17169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88918448e800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305719.261684:0:17169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788305719.261752:0:17169:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788305719.261766:0:17169:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788305719.262145:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279360:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788305719.262212:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015279360 offset 0 length 520: 4 00000040:00080000:0.0:1788305719.264247:0:17169:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305719.264536:0:17169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788305719.264681:0:17169:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1788305719.269207:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015279232:12345-0@lo:38:llog_process_th.0 Request processed in 37246us (37432us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305719.269253:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788305719.269706:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305719.269713:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305719.269716:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279232:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788305719.270019:0:17177:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788305719.270024:0:17177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788305719.271214:0:17169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788305719.271227:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305719.271265:0:17169:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788305719.271311:0:17169:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054677 00000100:00080000:1.0:1788305719.271322:0:17169:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305719.271328:0:17169:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305719.271375:0:17169:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184db4700 x1875174015279488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305719.271398:0:17169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788305719.271466:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305719.271469:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.271471:0:17169:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788305719.271474:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305719.271477:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.271478:0:17169:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305719.271481:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305719.271483:0:17169:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788305719.271485:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305719.271487:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.271488:0:17169:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788305719.271490:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305719.271492:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.271493:0:17169:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305719.271496:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788305719.271526:0:17169:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17169:1875174015279616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305719.271598:0:17169:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305719.271635:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015279616 00000100:00100000:1.0:1788305719.271640:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015279616 00000100:00100000:1.0:1788305719.271675:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305719.271682:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+9:17169:x1875174015279616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305719.271782:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+9:17169:x1875174015279616:12345-0@lo:502:llog_process_th.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.271790:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305719.271831:0:17169:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2b23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.271849:0:17169:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17169:1875174015279616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.272501:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279488:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788305719.272549:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015279488 offset 0 length 520: 4 00000020:01000000:1.0:1788305719.274174:0:17169:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305719.274188:0:17169:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305719.274190:0:17169:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305719.274195:0:17169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788305719.274505:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788305719.274530:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788305719.274554:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.274567:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9800/0x4a426866e60545eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545f2 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305719.274575:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889182f56000 from 1 10000000:01000000:0.0:1788305719.274578:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305719.274613:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.274621:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.274642:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.274664:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015279744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305719.274726:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.274770:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.275248:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015279744 00000100:00100000:3.0:1788305719.275375:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015279744 00000100:00100000:3.0:1788305719.275420:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788305719.275429:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+9:17131:x1875174015279744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305719.275447:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305719.275461:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605467e expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.275486:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605467e expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.275496:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605467e expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.275505:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305719.275551:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+10:17131:x1875174015279744:12345-0@lo:101:mount.lustre.0 Request processed in 123us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.275557:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788305719.276943:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015279744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305719.276968:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.276981:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.277596:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015279872:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788305719.277667:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.277712:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.277900:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015279872 00000100:00100000:1.0:1788305719.277906:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015279872 00000100:00100000:1.0:1788305719.277951:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305719.277960:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+10:17131:x1875174015279872:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788305719.277980:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788305719.277986:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788305719.278053:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+10:17131:x1875174015279872:12345-0@lo:256:mount.lustre.0 Request processed in 94us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.278061:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788305719.279128:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015279872:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788305719.279780:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305719.279808:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.279821:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305719.279830:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889182f56000 from 1 10000000:01000000:0.0:1788305719.279833:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305719.281403:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.281415:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.281426:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.281450:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305719.281524:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.281669:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.281753:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280000 00000100:00100000:1.0:1788305719.281760:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280000 00000100:00100000:1.0:1788305719.281840:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305719.281849:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+10:17131:x1875174015280000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305719.281869:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305719.281885:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605468c expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.281906:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605468c expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.281916:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605468c expref: 11 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.281924:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:1.0:1788305719.282018:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280000:12345-0@lo:101:mount.lustre.0 Request processed in 169us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.282025:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305719.282418:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305719.282434:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305719.282444:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305719.282507:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305719.282537:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305719.282570:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.282626:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280128 00000100:00100000:3.0:1788305719.282630:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280128 00000100:00100000:3.0:1788305719.282669:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305719.282678:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280128:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305719.282821:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280128:12345-0@lo:501:mount.lustre.0 Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.282827:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305719.284678:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305719.284743:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305719.284817:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305719.284872:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.285398:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280256 00000100:00100000:3.0:1788305719.285407:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280256 00000100:00100000:3.0:1788305719.285449:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305719.285458:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280256:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305719.285572:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280256:12345-0@lo:503:mount.lustre.0 Request processed in 113us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.285588:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305719.285703:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305719.289386:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17179:1875174015280384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305719.289489:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305719.289531:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890825ba840 going to sleep for 11 seconds 00000100:00100000:0.0:1788305719.289605:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280384 00000100:00100000:0.0:1788305719.289614:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280384 00000100:00100000:0.0:1788305719.289664:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305719.289674:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17179:x1875174015280384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788305719.290182:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+11:17179:x1875174015280384:12345-0@lo:502:llog_process_th.0 Request processed in 507us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305719.290198:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305719.290314:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17179:1875174015280384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305719.290346:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305719.290355:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290358:0:17179:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788305719.290365:0:17179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889182f56000 00000020:00000080:2.0:1788305719.290368:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788305719.290376:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305719.290378:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290379:0:17179:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788305719.290381:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305719.290383:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290385:0:17179:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788305719.290388:0:17179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff889182f56000 00000020:00000080:2.0:1788305719.290390:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788305719.290440:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305719.290444:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290445:0:17179:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788305719.290448:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305719.290450:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290451:0:17179:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305719.290454:0:17179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889182f56000 00000020:00000080:2.0:1788305719.290456:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788305719.290471:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305719.290473:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290475:0:17179:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788305719.290477:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305719.290479:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290480:0:17179:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788305719.290482:0:17179:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff889182f56000 00000020:00000080:2.0:1788305719.290484:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788305719.290522:0:17179:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17179:1875174015280512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305719.290558:0:17179:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305719.290583:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280512 00000100:00100000:2.0:1788305719.290587:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280512 00000100:00100000:2.0:1788305719.290609:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305719.290616:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+11:17179:x1875174015280512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305719.290690:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+11:17179:x1875174015280512:12345-0@lo:502:llog_process_th.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305719.290697:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305719.290732:0:17179:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305719.290744:0:17179:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17179:1875174015280512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788305719.290763:0:17179:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305719.290767:0:17179:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305719.290768:0:17179:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788305719.290772:0:17179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788305719.294229:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788305719.294270:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305719.294319:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.294332:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305719.294396:0:17131:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788305719.294400:0:17131:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff889182f56000 10000000:01000000:3.0:1788305719.294403:0:17131:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff889182f56000 10000000:01000000:3.0:1788305719.294406:0:17131:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305719.294412:0:17131:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff889182f56000 from 1 10000000:01000000:3.0:1788305719.294414:0:17131:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305719.294457:0:17131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.294465:0:17131:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.294477:0:17131:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305719.294501:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305719.294570:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.294609:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305719.294733:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280640 00000100:00100000:2.0:1788305719.294740:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280640 00000100:00100000:2.0:1788305719.294775:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305719.294784:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+11:17131:x1875174015280640:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305719.294796:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305719.294809:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21200/0x4a426866e60546a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605469a expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.294828:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21200/0x4a426866e60546a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605469a expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.294839:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21200/0x4a426866e60546a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605469a expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.294864:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21200, rc 0) 00000100:00100000:2.0:1788305719.294901:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015280640:12345-0@lo:101:mount.lustre.0 Request processed in 118us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305719.294908:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788305719.295993:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280640:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305719.296016:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305719.296034:0:17131:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305719.296113:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305719.296154:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.296185:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.296300:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280768 00000100:00100000:1.0:1788305719.296306:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280768 00000100:00100000:1.0:1788305719.296345:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788305719.296353:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015280768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305719.296467:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015280768:12345-0@lo:501:mount.lustre.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.296474:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788305719.297323:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305719.297363:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305719.297414:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.297445:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.297545:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015280896 00000100:00100000:1.0:1788305719.297551:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015280896 00000100:00100000:1.0:1788305719.297578:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305719.297585:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015280896:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305719.297667:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015280896:12345-0@lo:503:mount.lustre.0 Request processed in 82us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.297674:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305719.297752:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015280896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305719.324186:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788305719.324435:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305719.324511:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305719.327565:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281024 00000100:00100000:1.0:1788305719.327580:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281024 00000100:00100000:1.0:1788305719.327677:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305719.327689:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788305719.327879:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281024:12345-0@lo:502:llog_process_th.0 Request processed in 193us (3443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.327887:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788305719.328729:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281024:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788305719.328798:0:17182:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788305719.328812:0:17182:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8891bb4f3370) 00000020:00000080:2.0:1788305719.328831:0:17182:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788305719.329401:0:17182:0:(tgt_mount.c:153:server_get_mount()) get mount ffff889182f56000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788305719.329408:0:17182:0:(tgt_mount.c:187:server_put_mount()) put mount ffff889182f56000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788305719.329411:0:17182:0:(obd_mount.c:710:lustre_put_lsi()) put ffff889182f56000 4 00010000:00080000:2.0:1788305719.329441:0:17182:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88918fd78000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305719.331136:0:17182:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788305719.331429:0:17182:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788305719.331471:0:17182:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305719.331483:0:17182:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4a426866e60546af 00000100:00080000:2.0:1788305719.331493:0:17182:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305719.331499:0:17182:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88918fd78000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305719.331543:0:17182:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1ed80 x1875174015281152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305719.331580:0:17182:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788305719.334253:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015281152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305719.334354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.334501:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281152 00000100:00100000:3.0:1788305719.334509:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281152 00000100:00100000:3.0:1788305719.334539:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305719.334546:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015281152:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305719.334603:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875174015281152:12345-0@lo:38:llog_process_th.0 Request processed in 55us (248us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788305719.334609:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305719.334644:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305719.334651:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918fd78000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305719.334656:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788305719.334659:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015281152:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305719.338270:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.338382:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.338425:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281280 00000100:00100000:3.0:1788305719.338431:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281280 00000100:00100000:3.0:1788305719.338473:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788305719.338482:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.338610:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281280:12345-0@lo:502:llog_process_th.0 Request processed in 128us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.338619:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788305719.338662:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.338683:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.338721:0:17182:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.338753:0:17182:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.338769:0:17182:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918cad5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305719.338782:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281408 00000100:00100000:3.0:1788305719.338786:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281408 00000100:00100000:3.0:1788305719.338810:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788305719.338817:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788305719.341718:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17182:x1875174015281408:12345-0@lo:502:llog_process_th.0 Request processed in 2893us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305719.341733:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305719.342032:0:17182:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:739dca1e-bd16-46de-8d05-a6337c8af843:17182:1875174015281408:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788305719.342084:0:17182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788305719.342603:0:17131:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788305719.342642:0:17131:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788305719.342669:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.342681:0:17131:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181519c00/0x4a426866e605469a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546a1 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788305719.342735:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788305719.342737:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305719.342739:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305719.342740:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305719.342741:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305719.342743:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305719.342744:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305719.342746:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305719.342748:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305719.342750:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305719.342753:0:17131:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788305719.342755:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788305719.342757:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788305719.342758:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305719.342759:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305719.342760:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305719.342761:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305719.342762:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788305719.342763:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788305719.342764:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305719.342765:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788305719.342790:0:17131:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788305719.342806:0:17131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015281536:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788305719.343351:0:17131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305719.343760:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281536 00000100:00100000:3.0:1788305719.343768:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281536 00000100:00100000:3.0:1788305719.343824:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788305719.343835:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015281536:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788305719.343882:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788305719.343898:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788305719.348077:0:17131:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392c00 going to sleep for 11 seconds 20000000:01000000:1.0:1788305719.352168:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788305719.352189:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788305719.352637:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:17131:x1875174015281536:12345-0@lo:253:mount.lustre.0 Request processed in 8798us (9281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.352649:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 20000000:01000000:2.0:1788305719.352734:0:17167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788305719.352738:0:17167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788305719.352759:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.352792:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605467e expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.352801:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.352838:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605467e expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.352850:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605467e expref: 11 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305719.352876:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015281664:0@lo:104: 00000100:00100000:2.0:1788305719.352911:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305719.353002:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392240 going to sleep for 11 seconds 00000100:00100000:0.0:1788305719.355522:0:17131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17131:1875174015281536:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305719.355543:0:17131:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788305719.355546:0:17131:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305719.355548:0:17131:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788305719.355549:0:17131:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305719.355551:0:17131:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305719.355552:0:17131:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305719.355553:0:17131:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305719.355554:0:17131:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305719.355556:0:17131:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788305719.355558:0:17131:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305719.355560:0:17131:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788305719.355577:0:17131:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788305719.358020:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281664 00000100:00100000:1.0:1788305719.358035:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281664 00000100:00100000:1.0:1788305719.358107:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305719.358133:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015281664:12345-0@lo:104: 00010000:00010000:1.0:1788305719.358154:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363196:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305719.363213:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015281664:12345-0@lo:104: Request processed in 5079us (10297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.363225:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788305719.363269:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305719.363303:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363314:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305719.363318:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363327:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305719.363334:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305719.363340:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305719.363385:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363392:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305719.363414:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363438:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e605467e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054685 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363455:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305719.363457:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305719.363459:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305719.363496:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015281792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305719.363556:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305719.363634:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281792 00000100:00100000:1.0:1788305719.363641:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281792 00010000:00010000:1.0:1788305719.363667:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605467e expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305719.363693:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305719.363702:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+12:3648:x1875174015281792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305719.363714:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305719.363720:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605467e expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363731:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605467e expref: 12 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363749:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363758:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305719.363771:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011033127s 00010000:00010000:1.0:1788305719.363785:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363793:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363800:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363806:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363811:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305719.363817:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363824:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363833:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305719.363843:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305719.363877:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+12:3648:x1875174015281792:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305719.363885:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305719.363935:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015281792:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788305719.366321:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518600/0x4a426866e6054685 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605467e expref: 11 pid: 17145 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305719.366339:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015281664:0@lo:104: 00010000:00010000:2.0:1788305719.366361:0:17167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.366370:0:17167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.366376:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305719.366381:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20600/0x4a426866e60546b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788305719.379086:0:17131:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788305719.379614:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788305719.379933:0:17191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788305719.380053:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1788305719.380417:0:17192:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff889184db5880 x1875174015281920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305719.380441:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00000040:01000000:0.0:1788305719.380793:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788305719.380831:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788305719.381254:0:17131:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788305719.381262:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788305719.381679:0:17131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305719.382703:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788305719.383266:0:17131:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788305719.383336:0:17131:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000020:00080000:3.0:1788305719.383631:0:17190:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788305719.383635:0:17190:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1788305719.384219:0:17131:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00000040:00080000:1.0:1788305719.384709:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788305719.385271:0:17131:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000040:00080000:1.0:1788305719.392748:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788305719.392842:0:17191:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000001:00000004:0.0:1788305719.393783:0:17131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788305719.395978:0:17131:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788305719.396021:0:17131:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff94a3c1cdf988 00100000:10000000:2.0:1788305719.396029:0:17131:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788305719.397055:0:17131:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788305719.397071:0:17131:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788305719.397091:0:17131:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788305719.397128:0:17131:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788305719.398189:0:17131:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305719.398461:0:17131:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305719.829445:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305720.345459:0:17185:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305720.345469:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305720.346716:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1788305720.346726:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788305720.408246:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 10000000:01000000:2.0:1788305720.665498:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788305720.665506:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889182f56000 from 7 10000000:01000000:2.0:1788305720.665512:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788305720.665560:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305720.665572:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305720.665583:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305720.666370:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015282048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305720.666453:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305720.666546:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305720.670492:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282048 00000100:00100000:3.0:1788305720.670510:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282048 00000100:00100000:3.0:1788305720.670590:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305720.670615:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+11:17149:x1875174015282048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305720.670636:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305720.670672:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60546bd expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305720.670704:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60546bd expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305720.670715:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60546bd expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305720.670725:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519400, rc 0) 00000100:00100000:3.0:1788305720.670820:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17149:x1875174015282048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305720.670828:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788305720.671162:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015282048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305720.671183:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305720.671194:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305720.671423:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015282176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788305720.671469:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305720.671514:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2fb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788305720.671568:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282176 00000100:00100000:2.0:1788305720.671580:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282176 00000100:00100000:2.0:1788305720.671629:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305720.671637:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:17149:x1875174015282176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305720.671653:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305720.671679:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305720.671683:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788305720.671768:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:17149:x1875174015282176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305720.671775:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788305720.672028:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015282176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788305720.672077:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305720.672095:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305720.672105:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305720.853829:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305721.365473:0:17185:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788305721.365484:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305721.365619:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788305721.365667:0:17185:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788305721.365830:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00000100:00100000:1.0:1788305721.432988:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:2.0:1788305721.889569:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305722.455359:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:1.0:1788305722.903448:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305723.480423:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:2.0:1788305723.927729:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305724.373421:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305724.373427:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788305724.373431:0:38:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305724.373440:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1788305724.373445:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305724.373452:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305724.373475:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1d180 x1875174015282432/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305724.373490:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305724.373494:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305724.373497:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305724.373507:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305724.373510:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305724.373513:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788305724.373515:0:38:0:(import.c:65:import_set_state_nolock()) ffff88918fd78000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305724.373520:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff88918fd78000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305724.373535:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1ea00 x1875174015282560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305724.373586:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305724.373599:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015282304:0@lo:400:kworker.0 00000100:00100000:2.0:1788305724.373684:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305724.373754:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282304 00000100:00100000:2.0:1788305724.373762:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282304 00000100:00100000:2.0:1788305724.373936:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305724.373947:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:3650:x1875174015282304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305724.373996:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:3650:x1875174015282304:12345-0@lo:400:kworker.0 Request processed in 52us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305724.374003:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305724.374059:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015282304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305724.376172:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015282432:0@lo:38:kworker.0 00000100:00100000:3.0:1788305724.376312:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305724.376365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015282560:0@lo:38:kworker.0 00000100:00100000:3.0:1788305724.376405:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305724.376450:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282560 00000100:00100000:3.0:1788305724.376457:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282560 00000100:00100000:3.0:1788305724.376487:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305724.376494:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015282560:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788305724.376522:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 554 last 0 00000020:00000080:3.0:1788305724.376566:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4a426866e60546cb 00000004:00100000:3.0:1788305724.376583:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788305724.376734:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8891bf95b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305724.377402:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282432 00000100:00100000:2.0:1788305724.377410:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282432 00000100:00100000:2.0:1788305724.377446:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788305724.377452:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015282432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788305724.377467:0:17157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788305724.377782:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875174015282560:12345-0@lo:38:kworker.0 Request processed in 1284us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305724.378384:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305724.378446:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889083f1ea00 x1875174015282560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305724.378463:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788305724.378472:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788305724.378477:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305724.378480:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918fd78000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305724.378487:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875174015282560:0@lo:38:kworker.0 00000100:00100000:2.0:1788305724.408341:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015282432:12345-0@lo:38:kworker.0 Request processed in 30877us (32018us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305724.408368:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788305724.411144:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305724.411157:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305724.411161:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015282432:0@lo:38:kworker.0 00000100:00100000:0.0:1788305724.503403:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305724.950524:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305725.406877:0:17435:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788305725.534910:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305725.973496:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305726.549362:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00000020:00000004:2.0:1788305726.846516:0:17487:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305726.846758:0:17487:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788305726.997599:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305727.576505:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305728.021567:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788305728.469424:0:17538:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305728.469646:0:17538:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788305728.603577:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:0.0:1788305729.045465:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305729.495019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788305729.495029:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788305729.495034:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305729.495047:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 554 00000100:00100000:0.0:1788305729.495050:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305719/real 1788305719] req@ffff889184db4700 x1875174015279488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305729.495055:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788305729.495064:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305729.495091:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889184db4700 x1875174015279488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305729.495096:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb228700 x1875174015282816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305729.495104:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305719/real 1788305719] req@ffff8891b8e00000 x1875174015279360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305729 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305729.495106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788305729.495116:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b8e00000 x1875174015279360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305729 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305729.495131:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305729.495134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305729.495136:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305729.495140:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015282816:0@lo:38:kworker.0 00000100:00100000:3.0:1788305729.495182:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305729.495191:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015282688:0@lo:400:kworker.0 00000100:00100000:0.0:1788305729.495240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305729.495242:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305729.495322:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015282944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305729.495356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305729.495402:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282944 00000100:00100000:2.0:1788305729.495402:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282688 00000100:00100000:3.0:1788305729.495410:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282944 00000100:00100000:2.0:1788305729.495410:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282688 00000100:00100000:3.0:1788305729.495459:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305729.495469:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015282944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305729.495549:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015282944:12345-0@lo:400:kworker.0 Request processed in 79us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305729.495558:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788305729.495607:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891bb22ad80 x1875174015282944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305729.495622:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015282944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305729.495663:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305729.495673:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:3649:x1875174015282688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305729.495714:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:3649:x1875174015282688:12345-0@lo:400:kworker.0 Request processed in 43us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305729.495720:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305729.495757:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015282688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305729.495826:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015282816 00000100:00100000:3.0:1788305729.495831:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015282816 00000100:00100000:3.0:1788305729.495995:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305729.496022:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015282816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788305729.496044:0:17156:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788305729.502921:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305729.502980:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305729.502990:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279488:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788305729.503001:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305729.503020:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305729.503024:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015279360:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788305729.503554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305729.503561:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788305729.503565:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305729.503571:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1788305729.503578:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305729.503586:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891844f9000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305729.503646:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1f480 x1875174015283072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305729.503679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305729.503683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788305729.503684:0:8:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305729.503688:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 549 00000100:00080000:2.0:1788305729.503691:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305729.503696:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305729.503709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1f800 x1875174015283200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305729.504619:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283072:0@lo:8:kworker.0 00000400:00000100:0.0:1788305729.504717:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015283072 offset 0 length 520: 4 00000100:00100000:0.0:1788305729.504881:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283200:0@lo:8:kworker.0 00000400:00000100:0.0:1788305729.504909:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015283200 offset 0 length 520: 4 00000100:00100000:3.0:1788305729.523772:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015282816:12345-0@lo:38:kworker.0 Request processed in 27742us (28522us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788305729.523787:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788305729.524214:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305729.524226:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788305729.524231:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015282816:0@lo:38:kworker.0 00000100:00100000:1.0:1788305729.621344:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:2.0:1788305730.080876:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305730.645954:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:1.0:1788305731.095706:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305731.606044:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305731.669993:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305732.131494:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305732.703398:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:0.0:1788305733.148808:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305733.719131:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305734.169728:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305734.614867:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788305734.615828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305734.615839:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788305734.615852:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305734.615863:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:2.0:1788305734.615872:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788305734.615881:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305734.615922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1e300 x1875174015283456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305734.615949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305734.615953:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305734.615967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305734.615970:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305734.616041:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305734.616062:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015283584:0@lo:400:kworker.0 00000100:00100000:2.0:1788305734.616157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305734.616410:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283584 00000100:00100000:3.0:1788305734.616421:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283584 00000100:00100000:3.0:1788305734.616503:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305734.616517:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305734.616583:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015283584:12345-0@lo:400:kworker.0 Request processed in 69us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305734.616591:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305734.616625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283456:0@lo:38:kworker.0 00000100:00100000:3.0:1788305734.616662:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788305734.618457:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889083f1d500 x1875174015283584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305734.618483:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015283584:0@lo:400:kworker.0 00000100:00100000:2.0:1788305734.618553:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283456 00000100:00100000:2.0:1788305734.618561:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283456 00000100:00100000:2.0:1788305734.618602:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305734.618610:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015283456:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788305734.618657:0:17157:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788305734.628451:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015283328:0@lo:400:kworker.0 00000100:00100000:0.0:1788305734.628558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305734.629361:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283328 00000100:00100000:0.0:1788305734.629374:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283328 00000100:00100000:0.0:1788305734.629815:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305734.629829:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:3647:x1875174015283328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305734.629918:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+12:3647:x1875174015283328:12345-0@lo:400:kworker.0 Request processed in 93us (1361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305734.638361:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788305734.638604:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015283328:0@lo:400:kworker.0 00000100:00100000:2.0:1788305734.643576:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015283456:12345-0@lo:38:kworker.0 Request processed in 24888us (26836us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788305734.643598:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788305734.648948:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305734.649047:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305734.649054:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283456:0@lo:38:kworker.0 00000100:00100000:2.0:1788305734.756042:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:0.0:1788305735.203668:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305735.765427:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305736.225695:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305736.789358:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:0.0:1788305737.247199:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305737.813370:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00000020:01000004:2.0:1788305738.057266:0:17883:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788305738.057270:0:17883:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788305738.057272:0:17883:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788305738.057761:0:17883:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88918c9a0800 00000020:01000004:2.0:1788305738.057778:0:17883:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788305738.057791:0:17883:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788305738.057805:0:17883:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8891bb4f0000) 00000020:00000080:2.0:1788305738.057822:0:17883:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788305738.189186:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788305738.191147:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788305738.196796:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788305738.197788:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788305738.199315:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788305738.200633:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.206217:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.206657:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.206915:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.207700:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.207967:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.208219:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.208618:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.208875:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.211263:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.211943:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.212297:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.213072:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.213746:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.214224:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.215669:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.216236:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.216595:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.216814:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.217388:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.217961:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.218886:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.219811:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.220608:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.221827:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.222146:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.224915:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.225344:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788305738.225719:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788305738.227392:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788305738.228834:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.230101:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.230782:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.231604:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788305738.233905:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.234719:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788305738.235020:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788305738.237033:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.237653:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788305738.237960:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788305738.238200:0:17883:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788305738.253551:0:17883:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305738.254458:0:17883:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788305738.254470:0:17883:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305738.254483:0:17883:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e60546d9 00000020:01000004:0.0:1788305738.254490:0:17883:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788305738.254595:0:17883:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305738.254610:0:17883:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305738.254616:0:17883:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788305738.254646:0:17883:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788305738.254650:0:17883:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00010000:00010000:3.0:1788305738.262976:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788305738.266036:0:17883:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788305738.266083:0:17883:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788305738.266087:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788305738.266089:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305738.266090:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305738.266091:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305738.266092:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305738.266094:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305738.266095:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305738.266097:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305738.266098:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305738.266102:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788305738.266104:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305738.266106:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305738.266107:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305738.266108:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305738.266109:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305738.266110:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305738.266111:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305738.266112:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305738.266113:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788305738.266151:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788305738.266171:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283712:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788305738.266244:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.266410:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.268917:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283712 00000100:00100000:2.0:1788305738.268940:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283712 00000100:00100000:2.0:1788305738.269165:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305738.269176:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17883:x1875174015283712:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305738.269218:0:17145:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788305738.269221:0:17145:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788305738.269229:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788305738.269876:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+12:17883:x1875174015283712:12345-0@lo:253:mount.lustre.0 Request processed in 700us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.269885:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788305738.269982:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283712:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305738.270009:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788305738.270013:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305738.270015:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788305738.270017:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305738.270018:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305738.270034:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305738.270036:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305738.270037:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788305738.270039:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305738.270040:0:17883:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788305738.270060:0:17883:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88918c9a0800 from lustre-MDT0001 10000000:01000000:0.0:1788305738.270089:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788305738.270092:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788305738.270098:0:17883:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8891bb4f4d28 local copy 00010000:00010000:0.0:1788305738.270108:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.270203:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305738.270236:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.271240:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.271370:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283840 00000100:00100000:3.0:1788305738.271377:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283840 00000100:00100000:3.0:1788305738.271416:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305738.271425:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17883:x1875174015283840:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305738.271582:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17883:x1875174015283840:12345-0@lo:501:mount.lustre.0 Request processed in 158us (1345us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788305738.271590:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305738.271661:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283840:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788305738.271681:0:17883:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788305738.271717:0:17883:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788305738.271724:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.271733:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.271760:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88918c9a0800 10000000:01000000:0.0:1788305738.271765:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788305738.271769:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8891bb4f4d28 10000000:01000000:0.0:1788305738.271771:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788305738.271774:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8891bb4f4d28 from 1 10000000:01000000:0.0:1788305738.271777:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788305738.271807:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.271827:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.271837:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.271854:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305738.271886:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.271914:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.273718:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015283968 00000100:00100000:3.0:1788305738.273732:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015283968 00000100:00100000:3.0:1788305738.273782:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305738.273792:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+12:17883:x1875174015283968:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305738.273807:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305738.273826:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518600/0x4a426866e60546e7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60546e0 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.273874:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518600/0x4a426866e60546e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60546e0 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.273885:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518600/0x4a426866e60546e7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60546e0 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.273896:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518600, rc 0) 00000100:00100000:3.0:1788305738.273989:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+13:17883:x1875174015283968:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.273996:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305738.274150:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015283968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305738.274168:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274178:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.274199:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788305738.274218:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274226:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8c00/0x4a426866e60546e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546e7 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.274237:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff88918c9a0800 10000000:01000000:0.0:1788305738.274241:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788305738.274246:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff88918c9a0800 from 1 10000000:01000000:0.0:1788305738.274249:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788305738.274300:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274309:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274317:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.274335:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305738.274368:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.274396:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.274616:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284096 00000100:00100000:3.0:1788305738.274622:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284096 00000100:00100000:3.0:1788305738.274643:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305738.274650:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+13:17883:x1875174015284096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305738.274658:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305738.274667:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181519800/0x4a426866e60546f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60546ee expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.274748:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181519800/0x4a426866e60546f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60546ee expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.274761:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181519800/0x4a426866e60546f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60546ee expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.274769:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519800, rc 0) 00000100:00100000:3.0:1788305738.274808:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+14:17883:x1875174015284096:12345-0@lo:101:mount.lustre.0 Request processed in 158us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.274824:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788305738.274897:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305738.274909:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274916:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.274937:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788305738.274953:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.274959:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9a00/0x4a426866e60546ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60546f5 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.274965:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788305738.274968:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788305738.274973:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff88918c9a0800 10000000:01000000:0.0:1788305738.274981:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788305738.274995:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788305738.274998:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788305738.275014:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.275020:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.275026:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.275037:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305738.275065:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.275079:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.275205:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284224 00000100:00100000:3.0:1788305738.275210:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284224 00000100:00100000:3.0:1788305738.275228:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305738.275234:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+14:17883:x1875174015284224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305738.275242:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305738.275250:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889181518800/0x4a426866e6054703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60546fc expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.275264:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518800/0x4a426866e6054703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60546fc expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.275313:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889181518800/0x4a426866e6054703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60546fc expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.275321:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518800, rc 0) 00000100:00100000:3.0:1788305738.275348:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284224:12345-0@lo:101:mount.lustre.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.275354:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305738.275452:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305738.275463:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.275472:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305738.276871:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788305738.277546:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305738.281138:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788305738.281197:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788305738.281214:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788305738.281228:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788305738.281240:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788305738.281253:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788305738.281368:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788305738.281388:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788305738.281402:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788305738.281415:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788305738.281427:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788305738.281439:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788305738.281469:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788305738.281486:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788305738.281498:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788305738.281596:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788305738.281611:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788305738.281623:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788305738.281635:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788305738.281648:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788305738.281660:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788305738.281673:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788305738.281753:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788305738.281785:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788305738.281792:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788305738.281911:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305738.281999:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.282109:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.282152:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284352 00000100:00100000:3.0:1788305738.282159:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284352 00000100:00100000:3.0:1788305738.282300:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305738.282312:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305738.282458:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284352:12345-0@lo:501:mount.lustre.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.282466:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305738.282559:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305738.282590:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305738.282630:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.282909:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.283007:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284480 00000100:00100000:2.0:1788305738.283013:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284480 00000100:00100000:2.0:1788305738.283044:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788305738.283051:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305738.283860:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284480:12345-0@lo:503:mount.lustre.0 Request processed in 806us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.283870:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305738.284069:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284480:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305738.284535:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305738.284609:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284608:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.284669:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.284880:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.284956:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284608 00000100:00100000:1.0:1788305738.284963:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284608 00000100:00100000:2.0:1788305738.285023:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788305738.285034:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284608:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305738.285748:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284608:12345-0@lo:502:mount.lustre.0 Request processed in 713us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.285757:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305738.285854:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305738.286044:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788305738.286073:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788305738.286102:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788305738.286116:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788305738.286129:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788305738.286144:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788305738.286156:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788305738.286168:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788305738.286181:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788305738.286194:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788305738.286207:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788305738.286220:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788305738.286232:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788305738.286246:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788305738.286259:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788305738.286272:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788305738.286326:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788305738.286340:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788305738.286364:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788305738.286378:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788305738.286390:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788305738.286403:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788305738.286416:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788305738.286429:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788305738.286441:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788305738.286453:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788305738.286465:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788305738.286478:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788305738.286514:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788305738.286531:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788305738.286543:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788305738.286555:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788305738.286566:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788305738.286577:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788305738.286600:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788305738.286614:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788305738.286625:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788305738.286636:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788305738.286649:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788305738.286661:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788305738.286674:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788305738.286686:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788305738.286699:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788305738.286711:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788305738.286746:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.286797:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.286840:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.286998:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284736 00000100:00100000:3.0:1788305738.287011:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284736 00000100:00100000:3.0:1788305738.287048:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305738.287057:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305738.287168:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015284736:12345-0@lo:502:mount.lustre.0 Request processed in 112us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.287178:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305738.287694:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015284736:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305738.287752:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788305738.287762:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788305738.288799:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.288813:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.288815:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788305738.288821:0:17887:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788305738.288824:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305738.288839:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8891b8fa19b8) 00000020:00000080:3.0:1788305738.288862:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788305738.288868:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788305738.288967:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788305738.288974:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054711 00000020:00000080:3.0:1788305738.289190:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788305738.289196:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305738.289200:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.289203:0:17887:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788305738.289206:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.289210:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.289211:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788305738.289214:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788305738.289221:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8891b8fa4d28) 00000020:00000080:3.0:1788305738.289232:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788305738.289237:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788305738.289239:0:17887:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788305738.289242:0:17887:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788305738.289247:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788305738.289395:0:17887:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88918c9a0800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788305738.289418:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8891bdc44d28) 00000020:00000080:3.0:1788305738.289433:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788305738.289625:0:17887:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788305738.289631:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6054726 00000020:00000080:3.0:1788305738.289809:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788305738.289816:0:17887:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788305738.289821:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x4a426866e605472d 00080000:01000000:3.0:1788305738.289827:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788305738.289831:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054734 00010000:00010000:3.0:1788305738.395181:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788305738.396582:0:17887:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788305738.396953:0:17887:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788305738.400682:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788305738.400711:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305738.400720:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.400723:0:17887:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788305738.400726:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305738.400733:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.400735:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788305738.400738:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788305738.400744:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:00000080:1.0:1788305738.400774:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788305738.400792:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8890833d99b8) 00000020:00000080:1.0:1788305738.400817:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788305738.400823:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788305738.400903:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788305738.400911:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788305738.400918:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054742 00010000:00080000:1.0:1788305738.400961:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908273e000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:1.0:1788305738.402589:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788305738.413772:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305738.413788:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788305738.413834:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788305738.413855:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6054749 00000100:00080000:0.0:1788305738.413865:0:17887:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305738.413872:0:17887:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff88908273e000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305738.413907:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00000 x1875174015284864/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305738.413995:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015284864:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788305738.414084:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788305738.414209:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788305738.414299:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305738.414304:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414306:0:17887:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788305738.414309:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788305738.414312:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788305738.414314:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.414316:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.414317:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788305738.414319:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414321:0:17887:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788305738.414323:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305738.414328:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414329:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788305738.414333:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788305738.414364:0:17887:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788305738.414376:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305738.414379:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414380:0:17887:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788305738.414383:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788305738.414385:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788305738.414386:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.414388:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.414390:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788305738.414392:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414393:0:17887:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788305738.414396:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305738.414399:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788305738.414402:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.414403:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788305738.414406:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788305738.414410:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:0.0:1788305738.414438:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788305738.414441:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305738.414453:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff889186270000) 00000020:00000080:0.0:1788305738.414465:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788305738.414470:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788305738.414540:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788305738.414548:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788305738.414553:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054757 00010000:00080000:0.0:1788305738.414580:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88908273a000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305738.414793:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:0.0:1788305738.415774:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788305738.415989:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788305738.417003:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284864 00000100:00100000:1.0:1788305738.417014:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284864 00000100:00100000:1.0:1788305738.417054:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305738.417062:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3646:x1875174015284864:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305738.417088:0:17156:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1788305738.417133:0:17156:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605475e 00000004:00100000:1.0:1788305738.417150:0:17156:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788305738.417156:0:17156:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788305738.417642:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305738.417648:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788305738.417652:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305738.417658:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:2.0:1788305738.417662:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788305738.417668:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305738.417714:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1d500 x1875174015284992/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000040:00080000:0.0:1788305738.417888:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788305738.418260:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788305738.418413:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1788305738.418813:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015284992:0@lo:38:kworker.0 00000100:00100000:3.0:1788305738.418891:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788305738.419313:0:17892:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788305738.419317:0:17892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1788305738.419569:0:17157:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788305738.419580:0:17157:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000020:00000080:0.0:1788305738.422036:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788305738.422052:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788305738.422096:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788305738.422118:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6054765 00000100:00080000:0.0:1788305738.422128:0:17887:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788305738.422134:0:17887:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff88908273a000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305738.422168:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e00700 x1875174015285120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305738.426446:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.426457:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305738.426460:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.426462:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305738.427322:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015284992 00000100:00100000:1.0:1788305738.427332:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015284992 00000100:00100000:3.0:1788305738.427846:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305738.427856:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015284992:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788305738.427963:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3646:x1875174015284992:12345-0@lo:38:kworker.0 Request processed in 106us (9070us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788305738.427970:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305738.428958:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788305738.428978:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015285248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305738.429039:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305738.429089:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015285120:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788305738.429130:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015285120 offset 0 length 520: 4 00000100:00100000:2.0:1788305738.429170:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305738.429178:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788305738.429183:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788305738.429186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015284992:0@lo:38:kworker.0 00000100:00080000:2.0:1788305738.429342:0:17156:0:(import.c:65:import_set_state_nolock()) ffff88918c9a4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305738.429391:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015284864:12345-0@lo:38:llog_process_th.0 Request processed in 12327us (15306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.429399:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305738.429430:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305738.429436:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788305738.429444:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788305738.429450:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788305738.429453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305738.429465:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015284864:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305738.429633:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015285248 00000100:00100000:1.0:1788305738.429639:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015285248 00000100:00100000:1.0:1788305738.429677:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305738.429698:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015285248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305738.429742:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015285248:12345-0@lo:400:kworker.0 Request processed in 57us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.429749:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788305738.429947:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889083f1d880 x1875174015285248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305738.429958:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015285248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305738.429973:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305738.429980:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015285376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305738.430008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.430272:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015285376 00000100:00100000:1.0:1788305738.430304:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015285376 00000100:00100000:1.0:1788305738.430334:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305738.430342:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015285376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305738.430368:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788305738.430410:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875174015285376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.430427:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305738.430621:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015285376:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788305738.430891:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788305738.431049:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305738.431056:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.431058:0:17887:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788305738.431060:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788305738.431068:0:17887:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788305738.431070:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.431072:0:17887:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788305738.431073:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788305738.431076:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.431077:0:17887:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788305738.431080:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788305738.431085:0:17887:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788305738.431089:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305738.431090:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788305738.431093:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788305738.431097:0:17887:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.155@tcp to nid 0x20000c0a8ca9b (192.168.202.155@tcp) 00000020:01000000:0.0:1788305738.431120:0:17887:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788305738.431122:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788305738.431137:0:17887:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff889186273370) 00000020:00000080:0.0:1788305738.431159:0:17887:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788305738.431164:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788305738.431255:0:17887:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788305738.431262:0:17887:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788305738.431269:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x4a426866e6054773 00010000:00080000:0.0:1788305738.432755:0:17887:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8891894cc000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:0.0:1788305738.433014:0:17887:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788305738.433088:0:17887:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788305738.433104:0:17887:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788305738.447050:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.447059:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305738.447062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.447065:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1788305738.447823:0:17887:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305738.448182:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788305738.448670:0:17887:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788305738.451489:0:17895:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788305738.451498:0:17895:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788305738.452674:0:17887:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788305738.452762:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788305738.452808:0:17887:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788305738.452831:0:17887:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e605477a 00000100:00080000:1.0:1788305738.452843:0:17887:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788305738.452849:0:17887:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305738.452888:0:17887:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184db4e00 x1875174015285504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305738.452963:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015285504:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788305738.453038:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015285504 offset 0 length 520: 4 00000100:00080000:1.0:1788305738.453246:0:17887:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788305738.453334:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305738.453338:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.453340:0:17887:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788305738.453343:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305738.453347:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.453348:0:17887:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788305738.453351:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788305738.453353:0:17887:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788305738.453355:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305738.453358:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.453359:0:17887:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788305738.453361:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788305738.453363:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.453365:0:17887:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788305738.453368:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788305738.453394:0:17887:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788305738.453396:0:17887:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788305738.453398:0:17887:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788305738.453413:0:17887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:3.0:1788305738.453660:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305738.453665:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305738.453669:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305738.453672:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788305738.453807:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788305738.453839:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788305738.453861:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.453871:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8e00/0x4a426866e60546fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054703 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305738.453890:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a0800 from 1 10000000:01000000:0.0:1788305738.453893:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305738.453931:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.453940:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305738.453951:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.453968:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788305738.454160:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.454197:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891863e3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.454802:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015285632 00000100:00100000:1.0:1788305738.454810:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015285632 00000100:00100000:1.0:1788305738.454855:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305738.454864:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+15:17883:x1875174015285632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305738.454878:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305738.454892:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054781 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.454916:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054781 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.454938:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054781 expref: 16 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.454947:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51800, rc 0) 00000100:00100000:1.0:1788305738.455072:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+16:17883:x1875174015285632:12345-0@lo:101:mount.lustre.0 Request processed in 207us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.455079:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788305738.455168:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e03480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305738.455191:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.455201:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.456354:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285760:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788305738.456411:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.456440:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788305738.456582:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015285760 00000100:00100000:0.0:1788305738.456589:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015285760 00000100:00100000:0.0:1788305738.456631:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788305738.456640:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+16:17883:x1875174015285760:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788305738.456660:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788305738.456681:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788305738.456758:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788305738.456852:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+16:17883:x1875174015285760:12345-0@lo:256:mount.lustre.0 Request processed in 213us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305738.456860:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305738.457192:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285760:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788305738.458017:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305738.458046:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.458058:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305738.458067:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a0800 from 1 10000000:01000000:3.0:1788305738.458070:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305738.458103:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.458112:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.458121:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.458153:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285888:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305738.458201:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.458245:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.458716:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015285888 00000100:00100000:2.0:1788305738.458724:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015285888 00000100:00100000:2.0:1788305738.458779:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788305738.458789:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+16:17883:x1875174015285888:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305738.458802:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305738.458815:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605478f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.458840:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605478f expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.458850:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605478f expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.458860:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21600, rc 0) 00000100:00100000:2.0:1788305738.458914:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015285888:12345-0@lo:101:mount.lustre.0 Request processed in 125us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.458931:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305738.459025:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015285888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305738.459041:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.459050:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305738.459183:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305738.459219:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305738.459250:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.459312:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0168900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.459428:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286016 00000100:00100000:2.0:1788305738.459432:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286016 00000100:00100000:2.0:1788305738.459472:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788305738.459479:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286016:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305738.459567:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286016:12345-0@lo:501:mount.lustre.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.459574:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788305738.459715:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305738.459742:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305738.459779:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.459799:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0168900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.459892:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286144 00000100:00100000:2.0:1788305738.459897:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286144 00000100:00100000:2.0:1788305738.459935:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305738.459943:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286144:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305738.460026:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286144:12345-0@lo:503:mount.lustre.0 Request processed in 84us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.460034:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788305738.460115:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788305738.460577:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788305738.460654:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305738.460826:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.460849:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0168780 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.460905:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286272 00000100:00100000:2.0:1788305738.460909:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286272 00000100:00100000:2.0:1788305738.460952:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305738.460960:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305738.461062:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286272:12345-0@lo:502:mount.lustre.0 Request processed in 102us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.461069:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305738.461155:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305738.461417:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788305738.461446:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788305738.461463:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788305738.461478:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788305738.461491:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788305738.464754:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788305738.464819:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788305738.464835:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788305738.464849:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788305738.464862:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788305738.464875:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788305738.464938:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286400:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305738.465031:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.465080:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.465270:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286400 00000100:00100000:1.0:1788305738.465292:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286400 00000100:00100000:1.0:1788305738.465339:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788305738.465348:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305738.465472:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286400:12345-0@lo:502:mount.lustre.0 Request processed in 124us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.465480:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305738.465976:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286400:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305738.466040:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788305738.466051:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788305738.466979:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.466992:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.466995:0:17897:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305738.467003:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88918c9a0800 00000020:00000080:3.0:1788305738.467006:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305738.467013:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305738.467026:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467029:0:17897:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788305738.467033:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.467036:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467037:0:17897:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305738.467041:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88918c9a0800 00000020:00000080:3.0:1788305738.467043:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305738.467109:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305738.467113:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467114:0:17897:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788305738.467116:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.467119:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467120:0:17897:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305738.467124:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88918c9a0800 00000020:00000080:3.0:1788305738.467126:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305738.467161:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305738.467164:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467166:0:17897:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305738.467168:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305738.467171:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467172:0:17897:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788305738.467176:0:17897:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88918c9a0800 00000020:00000080:3.0:1788305738.467178:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305738.467204:0:17897:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305738.467207:0:17897:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305738.467209:0:17897:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788305738.467212:0:17897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788305738.467415:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788305738.467442:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305738.467467:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.467478:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305738.467535:0:17883:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788305738.467539:0:17883:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88918c9a0800 10000000:01000000:1.0:1788305738.467548:0:17883:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88918c9a0800 10000000:01000000:1.0:1788305738.467552:0:17883:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305738.467557:0:17883:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88918c9a0800 from 1 10000000:01000000:1.0:1788305738.467560:0:17883:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305738.467592:0:17883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.467602:0:17883:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.467611:0:17883:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305738.467633:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305738.467707:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.467739:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0168f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.474436:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286528 00000100:00100000:2.0:1788305738.474453:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286528 00000100:00100000:2.0:1788305738.474529:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788305738.474541:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+17:17883:x1875174015286528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305738.474562:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305738.474581:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21c00/0x4a426866e60547a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605479d expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.474621:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21c00/0x4a426866e60547a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605479d expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.474631:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21c00/0x4a426866e60547a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605479d expref: 18 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.474641:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21c00, rc 0) 00000100:00100000:2.0:1788305738.474731:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286528:12345-0@lo:101:mount.lustre.0 Request processed in 192us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.474738:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788305738.479976:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305738.480008:0:17883:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.480022:0:17883:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305738.487775:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788305738.488800:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305738.489649:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788305738.489765:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1788305738.489787:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1788305738.489800:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1788305738.489813:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1788305738.489839:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1788305738.489851:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1788305738.489862:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1788305738.489875:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1788305738.489887:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1788305738.489898:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1788305738.489909:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1788305738.489935:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1788305738.489952:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1788305738.489964:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1788305738.489976:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1788305738.490096:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1788305738.490114:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1788305738.490128:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1788305738.490142:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1788305738.490156:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1788305738.490169:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1788305738.490180:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1788305738.490192:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1788305738.490204:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1788305738.490217:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1788305738.490228:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1788305738.490239:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1788305738.490258:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1788305738.490263:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788305738.490381:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286656:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305738.490456:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.490623:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286656 00000100:00100000:3.0:1788305738.490630:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286656 00000100:00100000:1.0:1788305738.490785:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c0168900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.490833:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305738.490844:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286656:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305738.491004:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286656:12345-0@lo:501:mount.lustre.0 Request processed in 162us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.491021:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788305738.491228:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305738.491263:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305738.491401:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.491455:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305738.492380:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286784 00000100:00100000:0.0:1788305738.492388:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286784 00000100:00100000:0.0:1788305738.492435:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305738.492444:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305738.492591:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286784:12345-0@lo:503:mount.lustre.0 Request processed in 147us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305738.492599:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788305738.492895:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286784:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305738.493432:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305738.493589:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286912:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305738.493638:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.493779:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305738.495132:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015286912 00000100:00100000:0.0:1788305738.495146:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015286912 00000100:00100000:0.0:1788305738.495216:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305738.495226:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.495423:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015286912:12345-0@lo:502:mount.lustre.0 Request processed in 198us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305738.495431:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305738.495568:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015286912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305738.496098:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1788305738.496129:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1788305738.496146:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1788305738.496158:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1788305738.496170:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1788305738.496184:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1788305738.496197:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1788305738.496209:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1788305738.496223:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1788305738.496235:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1788305738.496247:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1788305738.496294:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1788305738.496312:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1788305738.496325:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1788305738.496336:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1788305738.496349:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1788305738.496361:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1788305738.496382:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1788305738.496394:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1788305738.496407:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1788305738.496420:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1788305738.496432:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1788305738.496444:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1788305738.496458:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1788305738.496471:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1788305738.496485:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1788305738.496496:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1788305738.496608:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1788305738.496626:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1788305738.496639:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1788305738.496651:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1788305738.496663:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1788305738.496673:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1788305738.496765:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1788305738.496784:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1788305738.496799:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1788305738.496812:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1788305738.496826:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1788305738.496840:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1788305738.496853:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1788305738.496865:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1788305738.496877:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1788305738.496891:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1788305738.496915:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1788305738.496945:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1788305738.496958:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1788305738.496971:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1788305738.496983:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1788305738.497036:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.497115:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.497153:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff889192d20780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305738.497180:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287040 00000100:00100000:0.0:1788305738.497186:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287040 00000100:00100000:0.0:1788305738.497222:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305738.497231:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.497353:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287040:12345-0@lo:502:mount.lustre.0 Request processed in 122us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305738.497361:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305738.497421:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305738.497582:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1788305738.497604:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1788305738.497624:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305738.497657:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.498110:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff889192d20780 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.498197:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287168 00000100:00100000:1.0:1788305738.498203:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287168 00000100:00100000:1.0:1788305738.498306:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788305738.498315:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305738.498424:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287168:12345-0@lo:502:mount.lustre.0 Request processed in 110us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.498431:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305738.498643:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305738.498777:0:17883:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1788305738.498788:0:17883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788305738.500881:0:17902:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788305738.500898:0:17902:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8891b917b370) 00000020:00000080:2.0:1788305738.500933:0:17902:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788305738.501008:0:17902:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88918c9a0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788305738.501012:0:17902:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88918c9a0800 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788305738.501015:0:17902:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88918c9a0800 3 00010000:00080000:2.0:1788305738.501058:0:17902:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8890820ba000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305738.503767:0:17902:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:2.0:1788305738.504052:0:17902:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788305738.504091:0:17902:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305738.504103:0:17902:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x4a426866e60547b2 00000100:00080000:2.0:1788305738.504114:0:17902:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305738.504120:0:17902:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8890820ba000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305738.504167:0:17902:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1d500 x1875174015287296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305738.504207:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015287296:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305738.504310:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305738.504379:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287296 00000100:00100000:2.0:1788305738.504387:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287296 00000100:00100000:2.0:1788305738.504806:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788305738.504814:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015287296:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788305738.504836:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:2.0:1788305738.504874:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x4a426866e60547b9 00000004:00100000:2.0:1788305738.504891:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788305738.505644:0:17152:0:(import.c:65:import_set_state_nolock()) ffff889083e4d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305738.505723:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875174015287296:12345-0@lo:38:llog_process_th.0 Request processed in 906us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.505731:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788305738.505753:0:17902:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788305738.505777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.505792:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305738.505795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305738.505798:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788305738.508508:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:3.0:1788305738.509953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff889083f1d500 x1875174015287296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305738.509969:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788305738.509979:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788305738.509987:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788305738.509993:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788305738.509996:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8890820ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788305738.510003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875174015287296:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788305738.518466:0:17883:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788305738.518592:0:17883:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788305738.518614:0:17883:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305738.518627:0:17883:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51600/0x4a426866e605479d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547a4 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788305738.518691:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788305738.518694:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788305738.518696:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305738.518697:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305738.518698:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305738.518700:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305738.518702:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305738.518704:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305738.518706:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305738.518710:0:17883:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788305738.518712:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788305738.518714:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788305738.518715:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305738.518716:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305738.518717:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305738.518718:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305738.518719:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305738.518720:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305738.518721:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788305738.518749:0:17883:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788305738.518769:0:17883:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305738.518854:0:17883:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305738.518904:0:17883:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c01683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.518939:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287424 00000100:00100000:1.0:1788305738.518946:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287424 00000100:00100000:1.0:1788305738.518993:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788305738.519003:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305738.519034:0:17145:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788305738.519049:0:17145:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788305738.532615:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788305738.532654:0:17145:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788305738.533060:0:17145:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788305738.534030:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17883:x1875174015287424:12345-0@lo:253:mount.lustre.0 Request processed in 15022us (15171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305738.534042:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788305738.534151:0:17883:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:17883:1875174015287424:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788305738.534165:0:17883:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788305738.534169:0:17883:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305738.534170:0:17883:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788305738.534172:0:17883:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305738.534173:0:17883:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305738.534174:0:17883:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305738.534175:0:17883:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305738.534177:0:17883:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788305738.534179:0:17883:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305738.534181:0:17883:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788305738.534195:0:17883:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788305738.539007:0:17167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788305738.539016:0:17167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788305738.539044:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539062:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60546bd expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539082:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054781 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539090:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539137:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 17 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539153:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 17 pid: 17145 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.539171:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015287552:0@lo:104: 00000100:00100000:3.0:1788305738.539242:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305738.539325:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539335:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 17 pid: 17146 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.539342:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015287680:0@lo:104: 00000100:00100000:3.0:1788305738.539364:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.539386:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908364e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305738.539413:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287552 00000100:00100000:3.0:1788305738.539420:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287552 00000100:00100000:3.0:1788305738.539457:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287680 00000100:00100000:3.0:1788305738.539460:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287680 00000100:00100000:3.0:1788305738.539474:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305738.539482:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:17167:x1875174015287552:12345-0@lo:104: 00010000:00010000:3.0:1788305738.539629:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539756:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305738.539764:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:17167:x1875174015287552:12345-0@lo:104: Request processed in 282us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.539771:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305738.539788:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305738.539795:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015287680:12345-0@lo:104: 00010000:00010000:3.0:1788305738.539803:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539834:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788305738.539840:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015287680:12345-0@lo:104: Request processed in 47us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.539845:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788305738.539860:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305738.539866:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539873:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305738.539877:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539886:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305738.539894:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305738.539907:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305738.539947:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539954:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305738.539973:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539980:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054788 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.539995:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305738.539998:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540002:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305738.540005:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540012:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305738.540018:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305738.540024:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305738.540035:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540041:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305738.540062:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540068:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083f20200/0x4a426866e60546bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60546c4 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540082:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305738.540084:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305738.540086:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305738.540092:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305738.540105:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305738.540117:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015287808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305738.540147:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.540172:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305738.540181:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015287936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305738.540204:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305738.540234:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287808 00000100:00100000:3.0:1788305738.540238:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287808 00010000:00010000:3.0:1788305738.540255:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 18 pid: 17145 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.540304:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015287936 00000100:00100000:3.0:1788305738.540307:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015287936 00010000:00010000:3.0:1788305738.540318:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 19 pid: 17146 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305738.540330:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305738.540336:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015287808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305738.540347:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305738.540352:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 19 pid: 17145 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540369:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 19 pid: 17145 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540385:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305738.540412:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+19:3647:x1875174015287808:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.540419:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305738.540432:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305738.540438:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+18:3650:x1875174015287936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305738.540445:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305738.540450:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 18 pid: 17146 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540458:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 18 pid: 17146 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540469:0:17137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540477:0:17137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788305738.540488:0:17137:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011033127s 00010000:00010000:3.0:1788305738.540493:0:17137:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.540626:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51800/0x4a426866e6054788 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6054781 expref: 18 pid: 17145 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305738.540638:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015287552:0@lo:104: 00010000:00010000:2.0:1788305738.540647:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181519400/0x4a426866e60546c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60546bd expref: 17 pid: 17146 timeout: 668 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305738.540654:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015287680:0@lo:104: 00010000:00010000:3.0:1788305738.540698:0:17137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540718:0:17137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.540726:0:17137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.544787:0:17167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.544823:0:17167:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305738.544830:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305738.549615:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015287808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305738.550253:0:17137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305738.550262:0:17137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.550301:0:17137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.550318:0:17137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.550326:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889181518c00/0x4a426866e60547c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305738.550347:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305738.550443:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+16:3650:x1875174015287936:12345-0@lo:103:ldlm_bl.0 Request processed in 10003us (10236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305738.550453:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305738.550621:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015287936:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788305738.551001:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1788305738.551313:0:17909:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1788305738.551886:0:17909:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788305738.552542:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788305738.554006:0:17910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.554082:0:17910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.554120:0:17910:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7cc0 going to sleep for 11 seconds 00000040:01000000:3.0:1788305738.554334:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788305738.554375:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788305738.555025:0:17883:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788305738.555034:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788305738.555084:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1788305738.556242:0:17908:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788305738.556249:0:17908:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788305738.559045:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788305738.560002:0:17909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788305738.560057:0:17909:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788305738.560099:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288064 00000100:00100000:2.0:1788305738.560109:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288064 00000040:00080000:3.0:1788305738.560675:0:17883:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788305738.560723:0:17883:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788305738.560844:0:17883:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305738.561073:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788305738.561087:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788305738.561210:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 126us (7128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.561218:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00080000:10000000:3.0:1788305738.561788:0:17883:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:0.0:1788305738.562696:0:17910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288064:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788305738.562735:0:17910:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788305738.562780:0:17910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.562840:0:17910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:3.0:1788305738.564229:0:17883:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788305738.564774:0:17910:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.564970:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288192 00000100:00100000:1.0:1788305738.564979:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288192 00000100:00100000:1.0:1788305738.565028:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305738.565038:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788305738.565224:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 186us (2382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.565233:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305738.565778:0:17910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.565889:0:17910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17910:1875174015288320:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.565943:0:17910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.565971:0:17910:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305738.566045:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288320 00000100:00100000:2.0:1788305738.566051:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288320 00000100:00100000:2.0:1788305738.566088:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788305738.566096:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17910:x1875174015288320:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788305738.566147:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17910:x1875174015288320:12345-0@lo:900:lod0001_rec0000.0 Request processed in 52us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305738.566154:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788305738.566256:0:17910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8891b8e02300 x1875174015288320/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305754 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305738.566268:0:17910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17910:1875174015288320:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.566339:0:17910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288448:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788305738.566367:0:17910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305738.566387:0:17910:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305738.566595:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288448 00000100:00100000:1.0:1788305738.566600:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288448 00000100:00100000:1.0:1788305738.566631:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305738.566647:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288448:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788305738.566789:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17910:x1875174015288448:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305738.566797:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305738.566858:0:17910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17910:1875174015288448:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788305738.566900:0:17910:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788305738.570895:0:17883:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788305738.570945:0:17883:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff94a3c1cdf988 00100000:10000000:3.0:1788305738.570953:0:17883:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:0.0:1788305738.572577:0:17910:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788305738.572658:0:17910:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788305738.572663:0:17910:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:01000004:2.0:1788305738.573307:0:17883:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788305738.573337:0:17883:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788305738.573365:0:17883:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788305738.573384:0:17883:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788305738.574237:0:17883:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305738.574512:0:17883:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788305738.837385:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305739.291239:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305739.542009:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788305739.861410:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305740.309616:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788305740.309680:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305740.309687:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a0800 from 8 10000000:01000000:0.0:1788305740.309692:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305740.309746:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305740.309759:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305740.309771:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305740.309797:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305740.309868:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305740.309942:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788305740.310134:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288576 00000100:00100000:1.0:1788305740.310141:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288576 00000100:00100000:1.0:1788305740.310194:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305740.310203:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+16:17149:x1875174015288576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305740.310215:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305740.310227:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60547c7 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.310248:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60547c7 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.310258:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547c7 expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.310267:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50400, rc 0) 00000100:00100000:1.0:1788305740.310337:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015288576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305740.310345:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788305740.310528:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305740.310543:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.310552:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305740.310627:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788305740.310661:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305740.310698:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182be7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305740.310792:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288704 00000100:00100000:1.0:1788305740.310797:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288704 00000100:00100000:1.0:1788305740.310828:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305740.310835:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015288704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788305740.310848:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305740.310862:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305740.310869:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788305740.310961:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015288704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305740.310968:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788305740.311170:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788305740.311210:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305740.311217:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.311225:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305740.311243:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305740.311245:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889182f56000 from 8 10000000:01000000:3.0:1788305740.311247:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305740.311262:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.311269:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.311298:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305740.311310:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305740.311333:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305740.311358:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182be7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305740.311403:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288832 00000100:00100000:1.0:1788305740.311407:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288832 00000100:00100000:1.0:1788305740.311435:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305740.311441:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015288832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305740.311450:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305740.311459:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60547d5 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.311474:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60547d5 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.311483:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547d5 expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305740.311491:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51a00, rc 0) 00000100:00100000:1.0:1788305740.311529:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015288832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305740.311534:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788305740.311791:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305740.311803:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.311811:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305740.311848:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288960:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788305740.311873:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305740.311893:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182be7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788305740.313423:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015288960 00000100:00100000:1.0:1788305740.313439:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015288960 00000100:00100000:1.0:1788305740.313506:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305740.313516:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015288960:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788305740.313538:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305740.313561:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305740.313565:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788305740.313928:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015288960:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 412us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305740.313936:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788305740.314053:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015288960:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788305740.314105:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305740.314120:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305740.314129:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305740.567197:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305740.886838:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:1.0:1788305741.335362:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305741.846898:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788305741.918299:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305742.357494:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305742.933395:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 0 seconds 00010000:00010000:3.0:1788305743.383993:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788305743.831456:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788305743.831464:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788305743.831467:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305743.831480:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8891bf99f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305743.831503:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184db4000 x1875174015289216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305743.831519:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305743.831523:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305743.831525:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305743.831528:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305743.831552:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305743.831555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788305743.831557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305743.831560:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305743.831601:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015289600:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.831674:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305743.831734:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305743.831740:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015289088:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.831772:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305743.831817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015289216:0@lo:38:kworker.0 00000100:00100000:1.0:1788305743.831851:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305743.831893:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.831921:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305743.831939:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305743.831945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015289472:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.831970:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305743.832005:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289600 00000100:00100000:1.0:1788305743.832013:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289600 00000100:00100000:1.0:1788305743.832052:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289344 00000100:00100000:1.0:1788305743.832055:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289344 00000100:00100000:1.0:1788305743.832070:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305743.832078:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015289600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.832126:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015289600:12345-0@lo:400:kworker.0 Request processed in 49us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305743.832134:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305743.832150:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305743.832156:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015289344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.832186:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015289344:12345-0@lo:400:kworker.0 Request processed in 30us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305743.832192:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305743.832210:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289088 00000100:00100000:1.0:1788305743.832214:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289088 00000100:00100000:1.0:1788305743.832239:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305743.832245:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:3649:x1875174015289088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.832272:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:3649:x1875174015289088:12345-0@lo:400:kworker.0 Request processed in 28us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305743.832320:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305743.832349:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289216 00000100:00100000:1.0:1788305743.832353:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289216 00000100:00100000:1.0:1788305743.832369:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289472 00000100:00100000:1.0:1788305743.832371:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289472 00000100:00100000:1.0:1788305743.832386:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305743.832390:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875174015289216:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788305743.832414:0:17157:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 573 last 0 00000020:00000080:1.0:1788305743.832448:0:17157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e60547e3 00000004:00100000:1.0:1788305743.832463:0:17157:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788305743.832468:0:17157:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788305743.832544:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305743.832552:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015289472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.832602:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015289472:12345-0@lo:400:kworker.0 Request processed in 51us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305743.832609:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305743.832657:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015289472:0@lo:400:kworker.0 00010000:00080000:1.0:1788305743.832670:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889184db5f80 x1875174015289344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305743.832679:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015289344:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.832708:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015289088:0@lo:400:kworker.0 00010000:00080000:1.0:1788305743.832719:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889184db4700 x1875174015289600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305743.832727:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015289600:0@lo:400:kworker.0 00000100:00100000:1.0:1788305743.833237:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305743.833248:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015289728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305743.833295:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305743.833463:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289728 00000100:00100000:0.0:1788305743.833468:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289728 00000100:00100000:0.0:1788305743.833501:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305743.833508:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015289728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305743.833533:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305743.833583:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015289728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305743.833590:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305743.833710:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015289728:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788305743.841941:0:17157:0:(import.c:65:import_set_state_nolock()) ffff88918665d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305743.842066:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015289216:12345-0@lo:38:kworker.0 Request processed in 9672us (10213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305743.842078:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788305743.842262:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788305743.842272:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788305743.842319:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788305743.842321:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891bf99f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788305743.842351:0:3646:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000395149f6): req@ffff889184db5880 x1875174015281920/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305743.842375:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015289216:0@lo:38:kworker.0 00000100:00100000:2.0:1788305743.842512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305743.842527:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015289856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305743.842752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305743.842832:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289856 00000100:00100000:0.0:1788305743.842839:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289856 00000100:00100000:0.0:1788305743.842892:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305743.842902:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015289856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305743.842930:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305743.842973:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015289856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305743.842980:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788305743.843332:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015289856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305743.844792:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305743.844839:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4de540 going to sleep for 11 seconds 00000100:00100000:2.0:1788305743.845992:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015281920 00000100:00100000:2.0:1788305743.846003:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015281920 00000100:00100000:2.0:1788305743.846073:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788305743.846083:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015281920:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788305743.846193:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015281920:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305743.846200:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305743.846549:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1875174015281920:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788305743.846608:0:17192:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788305743.846666:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1875174015289984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788305743.846704:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305743.846743:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788305743.847828:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015289984 00000100:00100000:2.0:1788305743.847838:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015289984 00000100:00100000:2.0:1788305743.847892:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788305743.847902:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015289984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788305743.848037:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015289984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 136us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305743.848044:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305743.848897:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1875174015289984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788305743.849003:0:17192:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1875174015290112:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788305743.849043:0:17192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305743.849080:0:17192:0:(client.c:2715:ptlrpc_set_wait()) set ffff88919e0bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788305743.849101:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015290112 00000100:00100000:3.0:1788305743.849106:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015290112 00000100:00100000:3.0:1788305743.849138:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305743.849165:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015290112:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788305743.849226:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17192:x1875174015290112:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305743.849233:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305743.849257:0:17192:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17192:1875174015290112:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788305743.849331:0:17192:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305743.855440:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788305743.855550:0:17192:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 24, retries 0 00000004:00080000:3.0:1788305743.855557:0:17192:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1788305744.398245:0:18153:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788305744.418418:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305744.855008:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305729/real 1788305729] req@ffff889083f1f480 x1875174015283072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305744.855041:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889083f1f480 x1875174015283072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305744.855051:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305729/real 1788305729] req@ffff889083f1f800 x1875174015283200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305744 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305744.855061:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889083f1f800 x1875174015283200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305744 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305744.855082:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305744.855109:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305744.855113:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283072:0@lo:8:kworker.0 00000100:00080000:0.0:1788305744.855120:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305744.855147:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305744.855151:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015283200:0@lo:8:kworker.0 00000100:00080000:3.0:1788305744.855437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305744.855442:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788305744.855445:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305744.855449:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788305744.855455:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788305744.855462:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891844f9000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305744.855479:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb229f80 x1875174015290496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305744.855490:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305744.855493:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305744.855494:0:36:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305744.855497:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 559 00000100:00080000:3.0:1788305744.855499:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788305744.855502:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305744.855511:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb22a680 x1875174015290624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305744.855545:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305744.855548:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305744.855551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305744.855553:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788305744.855793:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788305744.855862:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305744.855913:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305744.855924:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015290368:0@lo:400:kworker.0 00000100:00100000:2.0:1788305744.855955:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305744.855995:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015290368 00000100:00100000:2.0:1788305744.856002:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015290368 00000100:00100000:2.0:1788305744.856042:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305744.856050:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015290368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305744.856106:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1875174015290368:12345-0@lo:400:kworker.0 Request processed in 56us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305744.856114:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305744.856155:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015290368:0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856237:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015290880:0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856263:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305744.856314:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305744.856320:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015290240:0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305744.856365:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015291008:0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856382:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305744.856404:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015290240 00000100:00100000:0.0:1788305744.856407:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015290240 00000100:00100000:0.0:1788305744.856434:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788305744.856440:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:3647:x1875174015290240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856470:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:3647:x1875174015290240:12345-0@lo:400:kworker.0 Request processed in 30us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305744.856477:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788305744.856506:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015290752 00000100:00100000:0.0:1788305744.856510:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015290752 00000100:00100000:0.0:1788305744.856532:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291008 00000100:00100000:0.0:1788305744.856535:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291008 00000100:00100000:0.0:1788305744.856548:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305744.856553:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015290752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856588:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015290752:12345-0@lo:400:kworker.0 Request processed in 34us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305744.856594:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788305744.856605:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305744.856619:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015291008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856646:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015291008:12345-0@lo:400:kworker.0 Request processed in 28us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305744.856651:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788305744.856681:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015290240:0@lo:400:kworker.0 00010000:00080000:0.0:1788305744.856691:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb354e00 x1875174015291008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305744.856701:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015291008:0@lo:400:kworker.0 00000100:00100000:0.0:1788305744.856721:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015290496:0@lo:8:kworker.0 00000400:00000100:0.0:1788305744.856742:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015290496 offset 0 length 520: 4 00000100:00100000:0.0:1788305744.856756:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015290624:0@lo:8:kworker.0 00000400:00000100:0.0:1788305744.856771:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015290624 offset 0 length 520: 4 00010000:00080000:0.0:1788305744.856804:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb354700 x1875174015290752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305760 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305744.856812:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015290752:0@lo:400:kworker.0 00000100:00100000:2.0:1788305744.857421:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015290880 00000100:00100000:2.0:1788305744.857427:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015290880 00000100:00100000:2.0:1788305744.857462:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305744.857471:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015290880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305744.857516:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015290880:12345-0@lo:400:kworker.0 Request processed in 47us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305744.857523:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305744.857628:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015290880:0@lo:400:kworker.0 00010000:00010000:3.0:1788305745.429717:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788305745.655707:0:18205:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788305745.656494:0:18205:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305746.456907:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305746.951366:0:18255:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305746.951592:0:18255:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305747.478942:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788305748.247110:0:18304:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8b7d54e0 20000000:00000080:1.0:1788305748.247128:0:18304:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891be1fd400 uarg=0000000000000000 20000000:01000000:1.0:1788305748.247167:0:18304:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788305748.247256:0:18304:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788305748.247260:0:18304:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788305748.247939:0:18305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788305748.248100:0:18304:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788305748.257533:0:18304:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788305748.257727:0:18304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.257748:0:18304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.257755:0:18304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605478f expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.257762:0:18304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.257822:0:18304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605478f expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.257851:0:18304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605478f expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305748.257867:0:18304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18304:1875174015291136:0@lo:104: 00000100:00100000:2.0:1788305748.257936:0:18304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305748.258033:0:18304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305748.258041:0:18304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305748.258049:0:18304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18304:1875174015291264:0@lo:104: 00000100:00100000:2.0:1788305748.258071:0:18304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305748.258146:0:18304:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305748.258718:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291136 00000100:00100000:3.0:1788305748.258726:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291136 00000100:00100000:3.0:1788305748.258764:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291264 00000100:00100000:3.0:1788305748.258767:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291264 00000100:00100000:3.0:1788305748.258781:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305748.258790:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:18304:x1875174015291136:12345-0@lo:104: 00010000:00010000:3.0:1788305748.258803:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305748.258956:0:18304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18304:1875174015291136:0@lo:104: 00010000:00010000:3.0:1788305748.258989:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305748.258997:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:18304:x1875174015291136:12345-0@lo:104: Request processed in 208us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305748.259004:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305748.259021:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788305748.259028:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:18304:x1875174015291264:12345-0@lo:104: 00010000:00010000:3.0:1788305748.259036:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305748.259139:0:18304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18304:1875174015291264:0@lo:104: 00010000:00010000:2.0:1788305748.259159:0:18304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259434:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305748.259442:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259449:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519a00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305748.259452:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259460:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305748.259466:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305748.259471:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305748.259513:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259524:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788305748.259583:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015291392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305748.259626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305748.259719:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259728:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181519a00/0x4a426866e605478f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054796 expref: -99 pid: 17883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259740:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305748.259743:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259749:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305748.259753:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259759:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305748.259765:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305748.259771:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305748.259785:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.259791:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788305748.259864:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291392 00000100:00100000:0.0:1788305748.259869:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291392 00010000:00010000:0.0:1788305748.259890:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605478f expref: 18 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305748.259916:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305748.259923:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+18:3649:x1875174015291392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305748.259944:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305748.259950:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605478f expref: 18 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305748.259960:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605478f expref: 18 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305748.259974:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21600/0x4a426866e6054796 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605478f expref: 18 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305748.259987:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305748.260062:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788305748.260070:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:18304:x1875174015291264:12345-0@lo:104: Request processed in 1042us (1997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305748.260076:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788305748.260095:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305748.260120:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260128:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9c00/0x4a426866e605468c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054693 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260145:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305748.260147:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305748.260149:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305748.260187:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+17:3649:x1875174015291392:12345-0@lo:103:ldlm_bl.0 Request processed in 264us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305748.260193:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305748.260211:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015291520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305748.260234:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305748.260419:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291520 00000100:00100000:1.0:1788305748.260423:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291520 00010000:00010000:1.0:1788305748.260440:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305748.260513:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305748.260520:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:739dca1e-bd16-46de-8d05-a6337c8af843+17:3650:x1875174015291520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305748.260529:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305748.260533:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260542:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260553:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51c00/0x4a426866e6054693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605468c expref: 17 pid: 17147 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260564:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260572:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260586:0:17139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260654:0:17139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260669:0:17139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260676:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260681:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305748.260685:0:17139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260692:0:17139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260715:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305748.260724:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305748.260754:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:739dca1e-bd16-46de-8d05-a6337c8af843+16:3650:x1875174015291520:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305748.260760:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305748.260813:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015291520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305748.260858:0:18304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305748.260865:0:18304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305748.260871:0:18304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20a00/0x4a426866e60547ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305748.261894:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015291392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305748.510655:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305748.950558:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015291648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305748.950646:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305748.950822:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291648 00000100:00100000:0.0:1788305748.950870:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291648 00000100:00100000:0.0:1788305748.950948:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305748.950983:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015291648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305748.951022:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305748.951071:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015291648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305748.951078:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305748.951770:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015291648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305748.952840:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305738/real 1788305738] req@ffff889184db4e00 x1875174015285504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305748.952867:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889184db4e00 x1875174015285504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305748.952876:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305738/real 1788305738] req@ffff8891b8e00700 x1875174015285120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305748 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305748.952896:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891b8e00700 x1875174015285120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305748 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305748.952911:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305748.952935:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305748.952940:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015285504:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788305748.952945:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305748.952949:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305748.952952:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015285120:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788305748.953209:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305748.953220:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015291776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305748.953305:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305748.953359:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291776 00000100:00100000:1.0:1788305748.953365:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291776 00000100:00100000:1.0:1788305748.953413:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305748.953420:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015291776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305748.953448:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305748.953485:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1875174015291776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305748.953491:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305748.953524:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015291776:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788305748.954043:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305748.954053:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305748.954055:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305748.954058:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305748.954069:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305748.954072:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788305748.954075:0:38:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305748.954079:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1788305748.954083:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305748.954087:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff88908273a000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305748.954103:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1dc00 x1875174015292160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305748.954115:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305748.954118:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788305748.954120:0:38:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788305748.954122:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 568 00000100:00080000:2.0:1788305748.954124:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788305748.954127:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305748.954134:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1d180 x1875174015292288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305748.954500:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015292032:0@lo:400:kworker.0 00000100:00100000:0.0:1788305748.954545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305748.954572:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305748.954577:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015291904:0@lo:400:kworker.0 00000100:00100000:0.0:1788305748.954626:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305748.954668:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292032 00000100:00100000:0.0:1788305748.954674:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292032 00000100:00100000:0.0:1788305748.954844:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305748.954853:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015292032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305748.955031:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015292032:12345-0@lo:400:kworker.0 Request processed in 113us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305748.955040:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305748.955066:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015291904 00000100:00100000:0.0:1788305748.955070:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015291904 00000100:00100000:0.0:1788305748.955094:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305748.955099:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+16:3650:x1875174015291904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305748.955128:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+16:3650:x1875174015291904:12345-0@lo:400:kworker.0 Request processed in 29us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305748.955134:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788305748.955219:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305748.955229:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015292416:0@lo:400:kworker.0 00000100:00100000:0.0:1788305748.955255:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305748.955301:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292416 00000100:00100000:0.0:1788305748.956208:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292416 00000100:00100000:0.0:1788305748.956247:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305748.956254:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015292416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305748.956750:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015291904:0@lo:400:kworker.0 00010000:00080000:1.0:1788305748.956764:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889083f1e300 x1875174015292032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305748.956775:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015292032:0@lo:400:kworker.0 00000100:00100000:1.0:1788305748.956802:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015292160:0@lo:8:kworker.0 00000400:00000100:1.0:1788305748.956848:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015292160 offset 0 length 520: 4 00000100:00100000:1.0:1788305748.956874:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015292288:0@lo:8:kworker.0 00000400:00000100:1.0:1788305748.956906:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875174015292288 offset 0 length 520: 4 00000100:00100000:0.0:1788305748.957216:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015292416:12345-0@lo:400:kworker.0 Request processed in 961us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305748.957225:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788305748.961332:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889083f1ea00 x1875174015292416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305748.961350:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015292416:0@lo:400:kworker.0 00010000:00010000:1.0:1788305749.525494:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788305749.590402:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305749.590410:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a0800 from 13 10000000:01000000:0.0:1788305749.590420:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305749.590462:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305749.590473:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305749.590484:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305749.590509:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305749.590572:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305749.590613:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.590693:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292544 00000100:00100000:1.0:1788305749.590701:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292544 00000100:00100000:1.0:1788305749.590754:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305749.590763:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+16:17149:x1875174015292544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305749.590783:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305749.590798:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60547f1 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.590831:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60547f1 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.590843:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547f1 expref: 17 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.590851:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305749.590889:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.590895:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788305749.590934:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305749.590947:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.590954:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305749.591018:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.591040:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305749.591052:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff889187135900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.591063:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292672 00000100:00100000:1.0:1788305749.591066:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292672 00000100:00100000:1.0:1788305749.591085:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305749.591089:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.591191:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.591197:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788305749.591222:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.591243:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.591299:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305749.591310:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff889187135900 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.591320:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292800 00000100:00100000:1.0:1788305749.591322:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292800 00000100:00100000:1.0:1788305749.591338:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305749.591342:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.591412:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.591417:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788305749.591448:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305749.592841:0:18356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788305749.594656:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788305749.594705:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305749.594717:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305749.594729:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305749.594739:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305749.594743:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889182f56000 from 13 10000000:01000000:0.0:1788305749.594745:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305749.594786:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305749.594794:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305749.594804:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305749.594851:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305749.594918:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305749.595006:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.603540:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015292928 00000100:00100000:1.0:1788305749.603558:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015292928 00000100:00100000:1.0:1788305749.603628:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305749.603640:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+17:17149:x1875174015292928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305749.603660:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305749.603679:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60547ff expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.603706:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60547ff expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.603726:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547ff expref: 18 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.603734:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:1.0:1788305749.603814:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015292928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (8895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.603833:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788305749.603889:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015292928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305749.603907:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.603915:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305749.603983:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015293056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.604013:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305749.604039:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.604051:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293056 00000100:00100000:1.0:1788305749.604054:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293056 00000100:00100000:1.0:1788305749.604073:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305749.604078:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015293056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.604168:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015293056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.604174:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788305749.604212:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015293056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.604245:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015293184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.604304:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305749.604315:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb392e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305749.604324:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293184 00000100:00100000:1.0:1788305749.604327:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293184 00000100:00100000:1.0:1788305749.604344:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305749.604348:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015293184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305749.604411:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:17149:x1875174015293184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305749.604417:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305749.604450:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015293184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305749.605159:0:18358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788305749.605213:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788305749.605230:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305749.605240:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305749.605249:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788305749.979021:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788305750.549583:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305750.813801:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788305751.064430:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305751.573672:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305752.599003:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305753.622937:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305754.069511:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015293312:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305754.069634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305754.069790:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293312 00000100:00100000:0.0:1788305754.069801:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293312 00000100:00100000:0.0:1788305754.069875:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788305754.069889:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015293312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305754.070058:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305754.070133:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015293312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 247us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305754.070141:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305754.070377:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015293312:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788305754.071439:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305754.071523:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305754.071601:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305754.071606:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305754.071640:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305754.071644:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305754.071646:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305754.071650:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788305754.071711:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015293696:0@lo:400:kworker.0 00000100:00100000:0.0:1788305754.072007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305754.072055:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788305754.072062:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015293824:0@lo:400:kworker.0 00000100:00100000:0.0:1788305754.072093:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305754.072140:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293696 00000100:00100000:0.0:1788305754.072148:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293696 00000100:00100000:1.0:1788305754.072211:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015293440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788305754.072245:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305754.072268:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015293952:0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.072323:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305754.072343:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305754.072349:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015293568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.072378:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305754.072417:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293824 00000100:00100000:1.0:1788305754.072422:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293824 00000100:00100000:0.0:1788305754.076396:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293952 00000100:00100000:0.0:1788305754.076420:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293952 00000100:00100000:2.0:1788305754.076526:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305754.081083:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293568 00000100:00100000:3.0:1788305754.081117:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293568 00000100:00100000:3.0:1788305754.081221:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305754.081236:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:3649:x1875174015293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305754.081389:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+18:3649:x1875174015293568:12345-0@lo:400:kworker.0 Request processed in 156us (9009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305754.081398:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788305754.081451:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015293440 00000100:00100000:3.0:1788305754.081456:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015293440 00000100:00100000:1.0:1788305754.081712:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015293568:0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.081791:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305754.081799:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015293824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.081864:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875174015293824:12345-0@lo:400:kworker.0 Request processed in 66us (9770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305754.081872:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305754.081909:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015293824:0@lo:400:kworker.0 00000100:00100000:2.0:1788305754.083869:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015293696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.084877:0:17152:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788305754.084893:0:17152:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788305754.086224:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305754.086250:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015293952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.086397:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015293952:12345-0@lo:400:kworker.0 Request processed in 159us (14073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305754.086419:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788305754.086525:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e00380 x1875174015293952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305754.086656:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015293952:0@lo:400:kworker.0 00000100:00100000:3.0:1788305754.086987:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015293696:12345-0@lo:400:kworker.0 Request processed in 10438us (14979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305754.086997:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788305754.087393:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891b8e02680 x1875174015293696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305754.087407:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015293696:0@lo:400:kworker.0 00000100:00100000:1.0:1788305754.088312:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788305754.088329:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015293440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305754.088377:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788305754.088462:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015293440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (16216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305754.088470:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305754.088615:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015293440:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788305754.646529:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305755.670519:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305756.696885:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788305757.536261:0:18654:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788305757.536266:0:18654:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788305757.536267:0:18654:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788305757.536427:0:18654:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8891894cf800 00000020:01000004:0.0:1788305757.536441:0:18654:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788305757.536454:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788305757.536468:0:18654:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff88918402b370) 00000020:00000080:0.0:1788305757.536485:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788305757.592645:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788305757.593246:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788305757.593582:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788305757.594026:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788305757.594376:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788305757.594678:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788305757.594971:0:18654:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:0.0:1788305757.597828:0:18654:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305757.598048:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788305757.598063:0:18654:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305757.598075:0:18654:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e6054814 00000020:01000004:0.0:1788305757.598082:0:18654:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788305757.598105:0:18654:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305757.598109:0:18654:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305757.598116:0:18654:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788305757.598121:0:18654:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788305757.598133:0:18654:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8891840299b8) 00000020:00000080:0.0:1788305757.598144:0:18654:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788305757.599384:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305757.599577:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788305757.599584:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788305757.610028:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305757.610043:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788305757.610868:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305757.610875:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788305757.613255:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788305757.613468:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788305757.613474:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788305757.616456:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305757.616469:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788305757.646215:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305757.646488:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788305757.646948:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788305757.649305:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788305757.649319:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788305757.650363:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788305757.650378:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788305757.652485:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788305757.652681:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788305757.652688:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788305757.662973:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788305757.662996:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1788305757.718526:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305757.742788:0:18654:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788305757.743008:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788305757.743015:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788305757.746163:0:18654:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788305757.746176:0:18654:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788305757.750702:0:18654:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788305757.750734:0:18654:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788305757.750741:0:18654:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788305757.773910:0:18654:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788305757.773951:0:18654:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.155@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788305757.773955:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788305757.773957:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788305757.773958:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305757.773960:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305757.773961:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305757.773962:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305757.773963:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305757.773966:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305757.773967:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305757.773970:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788305757.773972:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305757.773974:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788305757.773975:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305757.773976:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305757.773977:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305757.773978:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305757.773979:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305757.773981:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305757.773982:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305757.774018:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788305757.774038:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294080:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788305757.774116:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305757.774165:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.774231:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294080 00000100:00100000:0.0:1788305757.774240:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294080 00000100:00100000:0.0:1788305757.774320:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788305757.774331:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:18654:x1875174015294080:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788305757.774370:0:17146:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788305757.774374:0:17146:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788305757.774377:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788305757.774710:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+18:18654:x1875174015294080:12345-0@lo:253:mount.lustre.0 Request processed in 380us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.774718:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788305757.774832:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294080:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788305757.774842:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788305757.774845:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788305757.774846:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788305757.774847:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788305757.774848:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788305757.774849:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788305757.774851:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788305757.774852:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788305757.774853:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788305757.774854:0:18654:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788305757.774871:0:18654:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8891894cf800 from lustre-OST0000 10000000:01000000:1.0:1788305757.774899:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788305757.774902:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788305757.774910:0:18654:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8891bb4f4d28 local copy 00010000:00010000:1.0:1788305757.774925:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.775036:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294208:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305757.775063:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.775093:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.775392:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294208 00000100:00100000:0.0:1788305757.775397:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294208 00000100:00100000:0.0:1788305757.775442:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788305757.775449:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:18654:x1875174015294208:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305757.775525:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:18654:x1875174015294208:12345-0@lo:501:mount.lustre.0 Request processed in 77us (460us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788305757.775532:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788305757.775601:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294208:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788305757.775615:0:18654:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788305757.775638:0:18654:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788305757.775654:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305757.775663:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305757.775687:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8891894cf800 10000000:01000000:2.0:1788305757.775691:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788305757.775696:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788305757.775698:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788305757.775702:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788305757.775704:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788305757.775727:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305757.775733:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305757.775743:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305757.775765:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788305757.775792:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.775817:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bf9bff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.775967:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294336 00000100:00100000:0.0:1788305757.775971:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294336 00000100:00100000:0.0:1788305757.775990:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788305757.775996:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+18:18654:x1875174015294336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305757.776004:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305757.776016:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8a00/0x4a426866e6054829 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054822 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.776036:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8a00/0x4a426866e6054829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054822 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.776045:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8a00/0x4a426866e6054829 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054822 expref: 19 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.776055:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8a00, rc 0) 00000100:00100000:0.0:1788305757.776090:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294336:12345-0@lo:101:mount.lustre.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.776095:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788305757.776159:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788305757.776171:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305757.776191:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305757.777444:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788305757.782502:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305757.785257:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788305757.785843:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788305757.785861:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788305757.785874:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788305757.785887:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788305757.785899:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788305757.785923:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788305757.785928:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788305757.786032:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305757.786103:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.786213:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.791595:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294464 00000100:00100000:0.0:1788305757.791609:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294464 00000100:00100000:1.0:1788305757.797045:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305757.797060:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305757.797260:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294464:12345-0@lo:501:mount.lustre.0 Request processed in 203us (11156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.797268:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788305757.797384:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305757.797439:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305757.797498:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.813170:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788305757.815843:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294592 00000100:00100000:3.0:1788305757.815859:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294592 00000100:00100000:3.0:1788305757.815932:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788305757.815942:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305757.817797:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294592:12345-0@lo:503:mount.lustre.0 Request processed in 1849us (20291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305757.817812:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788305757.818117:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788305757.818626:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788305757.818716:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305757.818790:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.818835:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788305757.819630:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294720 00000100:00100000:3.0:1788305757.819639:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294720 00000100:00100000:3.0:1788305757.819698:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305757.819707:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.820360:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294720:12345-0@lo:502:mount.lustre.0 Request processed in 652us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.820370:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788305757.822904:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305757.823170:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788305757.823203:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788305757.823218:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788305757.823233:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788305757.823248:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788305757.823262:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788305757.823314:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788305757.823330:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788305757.823341:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788305757.823354:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788305757.823367:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788305757.823379:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788305757.823414:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305757.823485:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.823529:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.823599:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294848 00000100:00100000:0.0:1788305757.823607:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294848 00000100:00100000:0.0:1788305757.823668:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788305757.823678:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294848:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.823807:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294848:12345-0@lo:502:mount.lustre.0 Request processed in 131us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.823815:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788305757.825014:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305757.825088:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788305757.825099:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1788305757.826441:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305757.826453:0:18671:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788305757.826461:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305757.826464:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788305757.826470:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305757.826485:0:18671:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8891b91799b8) 00000020:00000080:2.0:1788305757.826510:0:18671:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305757.826516:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305757.826601:0:18671:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891894cf800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788305757.826610:0:18671:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305757.826617:0:18671:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4a426866e6054837 00010000:00010000:2.0:1788305757.829652:0:18671:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788305757.835220:0:18671:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1788305757.843011:0:18671:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788305757.844778:0:18671:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788305757.844793:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305757.844802:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844804:0:18671:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788305757.844808:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788305757.844811:0:18671:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788305757.844813:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305757.844815:0:18671:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788305757.844816:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788305757.844819:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844820:0:18671:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788305757.844823:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305757.844827:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844828:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788305757.844832:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788305757.844834:0:18671:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788305757.844836:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305757.844838:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844839:0:18671:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788305757.844841:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305757.844852:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844853:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788305757.844857:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788305757.844889:0:18671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305757.844891:0:18671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305757.844892:0:18671:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788305757.844895:0:18671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788305757.845336:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788305757.845365:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788305757.845388:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.845400:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083f21e00/0x4a426866e6054822 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054829 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305757.845408:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cf800 from 1 10000000:01000000:1.0:1788305757.845411:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305757.845450:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.845458:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.845469:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.845508:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305757.845586:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.845622:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.845870:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015294976 00000100:00100000:0.0:1788305757.845878:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015294976 00000100:00100000:0.0:1788305757.845927:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788305757.845937:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+19:18654:x1875174015294976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305757.845950:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305757.845964:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605483e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.845989:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605483e expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.845998:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605483e expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.846007:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8400, rc 0) 00000100:00100000:0.0:1788305757.846051:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015294976:12345-0@lo:101:mount.lustre.0 Request processed in 114us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.846058:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788305757.846151:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015294976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305757.846166:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.846175:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788305757.847757:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788305757.848066:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788305757.848321:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788305757.848345:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788305757.848362:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788305757.848367:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788305757.848433:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305757.848495:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.848544:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295104 00000100:00100000:1.0:1788305757.848544:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305757.848550:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295104 00000100:00100000:2.0:1788305757.848598:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788305757.848607:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305757.848716:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295104:12345-0@lo:501:mount.lustre.0 Request processed in 111us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.848724:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788305757.848825:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305757.848853:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305757.848886:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.848910:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305757.848960:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295232 00000100:00100000:2.0:1788305757.848964:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295232 00000100:00100000:2.0:1788305757.848992:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788305757.848999:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305757.849081:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295232:12345-0@lo:503:mount.lustre.0 Request processed in 82us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.849088:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788305757.849131:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295232:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305757.849458:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305757.849517:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295360:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.849555:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305757.849587:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305757.849653:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295360 00000100:00100000:1.0:1788305757.849657:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295360 00000100:00100000:1.0:1788305757.849690:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788305757.849703:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305757.849798:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295360:12345-0@lo:502:mount.lustre.0 Request processed in 96us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.849804:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788305757.849874:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305757.850064:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788305757.850098:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788305757.850113:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788305757.850125:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788305757.850139:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788305757.850153:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788305757.850166:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788305757.850180:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788305757.850193:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788305757.850206:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788305757.850220:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788305757.850240:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.850295:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305757.850318:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305757.850438:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295488 00000100:00100000:1.0:1788305757.850442:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295488 00000100:00100000:1.0:1788305757.850473:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788305757.850480:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305757.850557:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295488:12345-0@lo:502:mount.lustre.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.850563:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788305757.850577:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788305757.850614:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788305757.850623:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788305757.851367:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305757.851385:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851387:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788305757.851395:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891894cf800 00000020:00000080:0.0:1788305757.851397:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305757.851405:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305757.851408:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851409:0:18675:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788305757.851412:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305757.851414:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851416:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788305757.851418:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8891894cf800 00000020:00000080:0.0:1788305757.851420:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305757.851484:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305757.851488:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851489:0:18675:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788305757.851491:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305757.851494:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851495:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305757.851498:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891894cf800 00000020:00000080:0.0:1788305757.851501:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305757.851519:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305757.851521:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851523:0:18675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788305757.851525:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788305757.851527:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851529:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788305757.851531:0:18675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8891894cf800 00000020:00000080:0.0:1788305757.851533:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788305757.851554:0:18675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788305757.851556:0:18675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788305757.851558:0:18675:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788305757.851561:0:18675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788305757.851725:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788305757.851759:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788305757.851781:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.851793:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305757.851837:0:18654:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788305757.851840:0:18654:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8891894cf800 10000000:01000000:1.0:1788305757.851843:0:18654:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8891894cf800 10000000:01000000:1.0:1788305757.851847:0:18654:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788305757.851852:0:18654:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8891894cf800 from 1 10000000:01000000:1.0:1788305757.851855:0:18654:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788305757.851882:0:18654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.851891:0:18654:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.851906:0:18654:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.851925:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295616:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788305757.851970:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.852006:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.852329:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295616 00000100:00100000:0.0:1788305757.852335:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295616 00000100:00100000:0.0:1788305757.852367:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788305757.852375:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+20:18654:x1875174015295616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788305757.852386:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305757.852400:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8200/0x4a426866e6054853 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605484c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.852421:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8200/0x4a426866e6054853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605484c expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.852431:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8200/0x4a426866e6054853 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605484c expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305757.852444:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8200, rc 0) 00000100:00100000:0.0:1788305757.852478:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015295616:12345-0@lo:101:mount.lustre.0 Request processed in 103us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.852484:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305757.852568:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305757.852581:0:18654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.852590:0:18654:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305757.867774:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788305757.868092:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788305757.868799:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788305757.868831:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788305757.868861:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788305757.868878:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788305757.868892:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788305757.868907:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788305757.868921:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788305757.868936:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788305757.868950:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788305757.868973:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788305757.868988:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788305757.869002:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788305757.869017:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788305757.869031:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788305757.869045:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788305757.869059:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788305757.869073:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788305757.869085:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788305757.869109:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788305757.869124:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788305757.869136:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788305757.869148:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788305757.869161:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788305757.869175:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788305757.869187:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788305757.869201:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788305757.869215:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788305757.870359:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788305757.870391:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788305757.870407:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788305757.870422:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788305757.870437:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788305757.870452:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788305757.870467:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788305757.870496:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788305757.871345:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788305757.871367:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788305757.871394:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788305757.871400:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788305757.871571:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305757.871641:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.871688:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c01683c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305757.876392:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295744 00000100:00100000:0.0:1788305757.876405:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295744 00000100:00100000:0.0:1788305757.876464:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788305757.876475:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015295744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305757.877103:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015295744:12345-0@lo:501:mount.lustre.0 Request processed in 628us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305757.877113:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788305757.877297:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788305757.877346:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295872:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305757.877393:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305757.877427:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891c01683c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305757.877427:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015295872 00000100:00100000:1.0:1788305757.877432:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015295872 00000100:00100000:1.0:1788305757.877512:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788305757.877521:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015295872:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305757.877620:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015295872:12345-0@lo:503:mount.lustre.0 Request processed in 99us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.877627:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788305757.878171:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015295872:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305757.878617:0:18654:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305757.878706:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296000:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.878764:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305757.879099:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305757.879368:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296000 00000100:00100000:2.0:1788305757.879374:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296000 00000100:00100000:2.0:1788305757.879411:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788305757.879419:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305757.879589:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296000:12345-0@lo:502:mount.lustre.0 Request processed in 170us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.879597:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788305757.881811:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305757.882060:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788305757.882091:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788305757.882106:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788305757.882120:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788305757.882133:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788305757.882145:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788305757.882158:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788305757.882172:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788305757.882192:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788305757.882204:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788305757.882217:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788305757.882232:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788305757.882244:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788305757.882296:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788305757.882316:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788305757.882329:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788305757.882341:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788305757.882354:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788305757.882368:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788305757.882381:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788305757.882394:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788305757.882407:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788305757.882419:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788305757.882433:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788305757.882447:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788305757.882460:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788305757.882474:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788305757.882487:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788305757.885080:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788305757.885129:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788305757.885142:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788305757.885152:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788305757.885163:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788305757.885173:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788305757.885183:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788305757.885193:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788305757.885203:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788305757.885214:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788305757.885224:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788305757.885237:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788305757.885250:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788305757.885292:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788305757.885310:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788305757.885323:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788305757.885337:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788305757.885360:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788305757.885373:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788305757.885384:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788305757.885443:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.886461:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305757.886515:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788305757.886541:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296128 00000100:00100000:2.0:1788305757.886548:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296128 00000100:00100000:2.0:1788305757.886599:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788305757.886609:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305757.886996:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296128:12345-0@lo:502:mount.lustre.0 Request processed in 387us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.887005:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788305757.887086:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305757.887262:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788305757.887319:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788305757.887351:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305757.887382:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305757.887409:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a2b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305757.887414:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296256 00000100:00100000:2.0:1788305757.887418:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296256 00000100:00100000:2.0:1788305757.887445:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788305757.887451:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305757.887622:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015296256:12345-0@lo:502:mount.lustre.0 Request processed in 170us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.887628:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788305757.887807:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015296256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305757.887843:0:18654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788305757.887850:0:18654:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788305757.889579:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788305757.889597:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8891b917cd28) 00000020:00000080:2.0:1788305757.889621:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788305757.892089:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891894cf800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788305757.892099:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891894cf800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788305757.892102:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cf800 3 00010000:00080000:2.0:1788305757.892141:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889082340000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305757.903872:0:18681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788305757.904100:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788305757.904148:0:18681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305757.904161:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4a426866e6054861 00000100:00080000:3.0:1788305757.904172:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305757.904178:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff889082340000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305757.904213:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb356a00 x1875174015296384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305757.904245:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788305757.904324:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305757.904328:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305757.904330:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305757.904332:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305757.904353:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305757.904356:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788305757.904359:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305757.904361:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788305757.904438:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015296512:0@lo:400:kworker.0 00000100:00100000:3.0:1788305757.904506:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305757.904551:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305757.904557:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015296896:0@lo:400:kworker.0 00000100:00100000:3.0:1788305757.904583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.906349:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015296384:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305757.906410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.906474:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015296768:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906502:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.906524:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305757.906545:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015296640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906580:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.906612:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296512 00000100:00100000:1.0:1788305757.906619:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296512 00000100:00100000:1.0:1788305757.906675:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296768 00000100:00100000:1.0:1788305757.906678:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296768 00000100:00100000:1.0:1788305757.906694:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305757.906701:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015296512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906765:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015296512:12345-0@lo:400:kworker.0 Request processed in 63us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.906773:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788305757.906788:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305757.906793:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015296768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906822:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015296768:12345-0@lo:400:kworker.0 Request processed in 28us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.906828:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305757.906848:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296896 00000100:00100000:1.0:1788305757.906852:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296896 00000100:00100000:1.0:1788305757.906871:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296384 00000100:00100000:1.0:1788305757.906874:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296384 00000100:00100000:1.0:1788305757.906880:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015296640 00000100:00100000:1.0:1788305757.906882:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015296640 00000100:00100000:1.0:1788305757.906893:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305757.906898:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015296896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906925:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015296896:12345-0@lo:400:kworker.0 Request processed in 27us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.906931:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305757.906942:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305757.906953:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015296640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.906976:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015296640:12345-0@lo:400:kworker.0 Request processed in 24us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.906982:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305757.906994:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788305757.906998:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015296384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305757.907018:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:1.0:1788305757.907049:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4a426866e6054868 00000004:00100000:1.0:1788305757.907063:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305757.907091:0:17152:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305757.907125:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875174015296384:12345-0@lo:38:llog_process_th.0 Request processed in 125us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.907132:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788305757.907176:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb354000 x1875174015296896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.907190:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015296896:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.907201:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015296512:0@lo:400:kworker.0 00010000:00080000:1.0:1788305757.907317:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb356a00 x1875174015296384/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.907325:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305757.907332:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788305757.907340:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788305757.907344:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788305757.907346:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082340000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305757.907356:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3646:1875174015296384:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305757.907382:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb354a80 x1875174015296640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.907391:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015296640:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.907399:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015296768:0@lo:400:kworker.0 00000020:01000004:3.0:1788305757.912408:0:18681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788305757.912427:0:18681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8891bdc419b8) 00000020:00000080:3.0:1788305757.912453:0:18681:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788305757.912547:0:18681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8891894cf800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305757.912552:0:18681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8891894cf800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788305757.912555:0:18681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8891894cf800 3 00010000:00080000:3.0:1788305757.912586:0:18681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff88919402f800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.155@tcp at head 00010000:00010000:3.0:1788305757.914206:0:18681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788305757.914426:0:18681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788305757.914471:0:18681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788305757.914485:0:18681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x4a426866e6054876 00000100:00080000:3.0:1788305757.914496:0:18681:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788305757.914502:0:18681:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff88919402f800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305757.914541:0:18681:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb357100 x1875174015297024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305757.914576:0:18681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788305757.914878:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015297024:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305757.915026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788305757.915699:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305757.915704:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305757.915707:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305757.915710:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305757.915724:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305757.915727:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788305757.915730:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788305757.915733:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305757.915822:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015297152:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.915863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.915904:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305757.915910:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015297536:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.915935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.915960:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.915983:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.916000:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305757.916005:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015297280:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916025:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.916052:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297152 00000100:00100000:1.0:1788305757.916058:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297152 00000100:00100000:1.0:1788305757.916099:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788305757.916108:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3650:x1875174015297152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916151:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3650:x1875174015297152:12345-0@lo:400:kworker.0 Request processed in 44us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916159:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788305757.916196:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297536 00000100:00100000:1.0:1788305757.916199:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297536 00000100:00100000:1.0:1788305757.916218:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297280 00000100:00100000:1.0:1788305757.916221:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297280 00000100:00100000:1.0:1788305757.916234:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305757.916240:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015297536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916303:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015297536:12345-0@lo:400:kworker.0 Request processed in 33us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916311:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305757.916322:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305757.916328:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015297280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916358:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015297280:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916364:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305757.916383:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297024 00000100:00100000:1.0:1788305757.916386:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297024 00000100:00100000:1.0:1788305757.916400:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297408 00000100:00100000:1.0:1788305757.916402:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297408 00000100:00100000:1.0:1788305757.916423:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788305757.916424:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788305757.916428:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788305757.916429:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015297408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916455:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015297408:12345-0@lo:400:kworker.0 Request processed in 26us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916461:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305757.916472:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788305757.916476:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3646:x1875174015297024:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788305757.916512:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1788305757.916559:0:17153:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x4a426866e605487d 00000004:00100000:1.0:1788305757.916578:0:17153:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788305757.916610:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6f000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788305757.916617:0:18681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000100:00100000:1.0:1788305757.916659:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875174015297024:12345-0@lo:38:llog_process_th.0 Request processed in 181us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916666:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788305757.916728:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb357100 x1875174015297024/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305767 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.916738:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305757.916755:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788305757.916762:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788305757.916766:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788305757.916769:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88919402f800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305757.916774:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3646:1875174015297024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788305757.916775:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305757.916785:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015297664:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916805:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015297280:0@lo:400:kworker.0 00010000:00080000:1.0:1788305757.916815:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889083f1ea00 x1875174015297408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305757.916815:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.916823:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015297408:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916834:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305757.916838:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015297792:0@lo:400:kworker.0 00000020:01000000:0.0:1788305757.916851:0:18654:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 00000100:00100000:1.0:1788305757.916859:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788305757.916880:0:18654:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:1.0:1788305757.916883:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015297536:0@lo:400:kworker.0 00000100:00100000:1.0:1788305757.916890:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015297152:0@lo:400:kworker.0 00010000:00010000:0.0:1788305757.916894:0:18654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.916904:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297664 00010000:00010000:0.0:1788305757.916905:0:18654:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51000/0x4a426866e605484c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054853 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.916906:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297664 00000100:00100000:1.0:1788305757.916928:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297792 00000100:00100000:1.0:1788305757.916930:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297792 00000020:01000004:0.0:1788305757.916951:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000100:00100000:1.0:1788305757.916952:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000020:01000004:0.0:1788305757.916953:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305757.916955:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305757.916956:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:1.0:1788305757.916957:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015297664:12345-0@lo:400:kworker.0 00000020:01000004:0.0:1788305757.916958:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305757.916959:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305757.916961:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305757.916963:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305757.916964:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788305757.916967:0:18654:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788305757.916970:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788305757.916971:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305757.916972:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305757.916973:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305757.916974:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305757.916975:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305757.916977:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305757.916978:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305757.916979:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1788305757.916985:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015297664:12345-0@lo:400:kworker.0 Request processed in 29us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.916990:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:0.0:1788305757.916991:0:18654:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788305757.917001:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305757.917001:0:18654:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015297920:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788305757.917007:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015297792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305757.917029:0:18654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.917031:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015297792:12345-0@lo:400:kworker.0 Request processed in 25us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.917037:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788305757.917046:0:18654:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918a88cd80 going to sleep for 11 seconds 00000100:00080000:1.0:1788305757.917069:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788305757.917086:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff889083f1df80 x1875174015297664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.917096:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015297664:0@lo:400:kworker.0 00010000:00080000:1.0:1788305757.917118:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8891bb22b100 x1875174015297792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305757.917126:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015297792:0@lo:400:kworker.0 00000100:00100000:2.0:1788305757.918309:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015297920 00000100:00100000:2.0:1788305757.918319:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015297920 00000100:00100000:2.0:1788305757.918359:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788305757.918367:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015297920:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305757.918392:0:17147:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788305757.918407:0:17147:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788305757.928176:0:17147:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788305757.928199:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788305757.928454:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:18654:x1875174015297920:12345-0@lo:253:mount.lustre.0 Request processed in 10082us (11418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305757.928465:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788305757.928511:0:18654:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:18654:1875174015297920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788305757.928526:0:18654:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788305757.928530:0:18654:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788305757.928531:0:18654:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788305757.928532:0:18654:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788305757.928533:0:18654:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788305757.928535:0:18654:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788305757.928536:0:18654:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788305757.928538:0:18654:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788305757.928539:0:18654:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788305757.928541:0:18654:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788305757.928556:0:18654:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788305757.928613:0:17167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788305757.928619:0:17167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788305757.928642:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928659:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928666:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547d5 expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928683:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928718:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928734:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 20 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305757.928758:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015298048:0@lo:104: 00000100:00100000:3.0:1788305757.928793:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305757.928843:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.928852:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305757.928860:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015298176:0@lo:104: 00000100:00100000:3.0:1788305757.928884:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.928991:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298048 00000100:00100000:1.0:1788305757.928998:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298048 00000100:00100000:1.0:1788305757.929042:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305757.929052:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015298048:12345-0@lo:104: 00010000:00010000:1.0:1788305757.929064:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929122:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305757.929128:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015298048:12345-0@lo:104: Request processed in 78us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.929135:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788305757.929154:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305757.929160:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929167:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305757.929171:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929180:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305757.929189:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305757.929195:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305757.929236:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929243:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305757.929263:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929271:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889181518c00/0x4a426866e60547d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547dc expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.929312:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305757.929314:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305757.929315:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305757.929328:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015298304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305757.929356:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305757.929668:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083768780 going to sleep for 11 seconds 00000100:00100000:3.0:1788305757.929685:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015298048:0@lo:104: 00000100:00100000:3.0:1788305757.929706:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298304 00000100:00100000:3.0:1788305757.929709:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298304 00010000:00010000:3.0:1788305757.929728:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 21 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305757.929765:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305757.929773:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+21:3648:x1875174015298304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305757.929794:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305757.929800:0:17137:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 21 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.929811:0:17137:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 21 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.929826:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51a00/0x4a426866e60547dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60547d5 expref: 21 pid: 17145 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305757.929838:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305757.929869:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:739dca1e-bd16-46de-8d05-a6337c8af843+20:3648:x1875174015298304:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305757.929877:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305757.930015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015298304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305757.930071:0:17135:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788305757.930082:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298176 00000100:00100000:1.0:1788305757.930085:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298176 00000100:00100000:1.0:1788305757.930142:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305757.930150:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015298176:12345-0@lo:104: 00010000:00010000:1.0:1788305757.930158:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.930203:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305757.930209:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb2a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015298176:12345-0@lo:104: Request processed in 61us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.930215:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305757.930303:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015298176:0@lo:104: 00010000:00010000:3.0:1788305757.930318:0:17167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.937042:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305757.937055:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.937066:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305757.937069:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.937080:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305757.937108:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305757.937113:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788305757.938644:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.938655:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305757.938686:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.938694:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8800/0x4a426866e60547c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547ce expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.938713:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305757.938715:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305757.938718:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305757.938727:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305757.938758:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015298432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305757.938833:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305757.938940:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298432 00000100:00100000:1.0:1788305757.938948:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298432 00010000:00010000:1.0:1788305757.938976:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305757.939007:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305757.939015:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+20:3650:x1875174015298432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305757.939027:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305757.939046:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939059:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939074:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50400/0x4a426866e60547ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60547c7 expref: 20 pid: 17147 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939090:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939098:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788305757.939114:0:17138:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011033127s 00010000:00010000:1.0:1788305757.939119:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939127:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939134:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939141:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939147:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305757.939151:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939168:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939183:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.939193:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305757.939686:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+19:3650:x1875174015298432:12345-0@lo:103:ldlm_bl.0 Request processed in 669us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305757.939694:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305757.940561:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015298432:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305757.940591:0:17167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.940601:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305757.940606:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183564e00/0x4a426866e6054884 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788305757.942906:0:18654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788305757.945943:0:18654:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788305757.945953:0:18654:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788305757.945986:0:18654:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788305757.946028:0:18654:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788305757.946049:0:18654:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788305757.946066:0:18654:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788305757.946879:0:18654:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305757.947065:0:18654:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788305758.741512:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305759.094929:0:18734:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305759.095355:0:18734:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788305759.190591:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015298560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305759.190668:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305759.190729:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298560 00000100:00100000:1.0:1788305759.190748:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298560 00000100:00100000:1.0:1788305759.190798:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305759.190808:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015298560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305759.190848:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305759.190908:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015298560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305759.190915:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305759.190963:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015298560:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305759.195512:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305759.195535:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015298688:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305759.195606:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305759.195750:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298688 00000100:00100000:1.0:1788305759.195758:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298688 00000100:00100000:1.0:1788305759.195800:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305759.195809:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015298688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305759.195843:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788305759.195886:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015298688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305759.195893:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305759.195931:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015298688:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788305759.574798:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305759.574807:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a0800 from 9 10000000:01000000:0.0:1788305759.574813:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305759.574880:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.574893:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.574905:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305759.574933:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015298816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305759.575005:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305759.575056:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305759.575186:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298816 00000100:00100000:1.0:1788305759.575195:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298816 00000100:00100000:1.0:1788305759.575251:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788305759.575260:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+19:17149:x1875174015298816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305759.575297:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305759.575313:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605488b expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305759.575337:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605488b expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305759.575346:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605488b expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305759.575356:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:1.0:1788305759.575406:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+20:17149:x1875174015298816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305759.575413:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788305759.575575:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015298816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305759.575589:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.575611:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305759.575674:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015298944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305759.575703:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305759.575739:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305759.575776:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015298944 00000100:00100000:2.0:1788305759.575781:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015298944 00000100:00100000:2.0:1788305759.575814:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788305759.575822:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:17149:x1875174015298944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305759.575837:0:17147:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305759.575853:0:17147:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305759.575856:0:17147:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788305759.575941:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:17149:x1875174015298944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305759.575948:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788305759.576142:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015298944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788305759.576199:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305759.576207:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.576215:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305759.576225:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788305759.576227:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889182f56000 from 9 10000000:01000000:0.0:1788305759.576230:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788305759.576246:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.576254:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.576262:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305759.576296:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015299072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305759.576329:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305759.576346:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305759.576406:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299072 00000100:00100000:2.0:1788305759.576410:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299072 00000100:00100000:2.0:1788305759.576443:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788305759.576450:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+20:17149:x1875174015299072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305759.576457:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305759.576468:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054899 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305759.576485:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054899 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305759.576494:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054899 expref: 21 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305759.576511:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20400, rc 0) 00000100:00100000:2.0:1788305759.576540:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015299072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305759.576546:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788305759.576610:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015299072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305759.576621:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.576628:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305759.576677:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015299200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788305759.576707:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305759.576746:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788305759.576824:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299200 00000100:00100000:2.0:1788305759.576829:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299200 00000100:00100000:2.0:1788305759.576859:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788305759.576866:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015299200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788305759.576886:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788305759.576898:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788305759.576901:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788305759.576961:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015299200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305759.576967:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788305759.577227:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015299200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788305759.577268:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788305759.577317:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305759.577326:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305759.766947:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305760.022930:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305760.795560:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305761.305853:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305761.813593:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305762.838900:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305763.030329:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305748/real 1788305748] req@ffff889083f1dc00 x1875174015292160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305763.030356:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889083f1dc00 x1875174015292160/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305763.030366:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305748/real 1788305748] req@ffff889083f1d180 x1875174015292288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305763 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305763.030375:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff889083f1d180 x1875174015292288/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305763 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305763.030401:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305763.030430:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788305763.030434:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015292160:0@lo:8:kworker.0 00000100:00080000:3.0:1788305763.030439:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305763.030444:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788305763.030446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015292288:0@lo:8:kworker.0 00000100:00080000:0.0:1788305763.030587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305763.030591:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305763.030594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305763.030597:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788305763.030609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305763.030617:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788305763.030619:0:8:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305763.030624:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1788305763.030628:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305763.030634:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff88908273a000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305763.030651:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184024380 x1875174015299840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305763.030663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305763.030665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305763.030667:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305763.030670:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:0.0:1788305763.030672:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788305763.030675:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305763.030684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889184027480 x1875174015299968/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305763.030733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015299712:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.030807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.030840:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788305763.030846:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015299328:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.030873:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.030898:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015300096:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.030920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.030945:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015299456:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.030968:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.030993:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015300224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031018:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.031035:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788305763.031041:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015299584:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031060:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.031076:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015300352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031101:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.031136:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299712 00000100:00100000:0.0:1788305763.031144:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299712 00000100:00100000:0.0:1788305763.031183:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299456 00000100:00100000:0.0:1788305763.031186:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299456 00000100:00100000:0.0:1788305763.031202:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305763.031211:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015299712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031265:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015299712:12345-0@lo:400:kworker.0 Request processed in 54us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031271:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788305763.031313:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305763.031320:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015299456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031351:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015299456:12345-0@lo:400:kworker.0 Request processed in 32us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031357:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788305763.031372:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299328 00000100:00100000:0.0:1788305763.031376:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299328 00000100:00100000:0.0:1788305763.031400:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305763.031406:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:3647:x1875174015299328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031431:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:3647:x1875174015299328:12345-0@lo:400:kworker.0 Request processed in 26us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031445:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788305763.031471:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300096 00000100:00100000:0.0:1788305763.031474:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300096 00000100:00100000:0.0:1788305763.031489:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300224 00000100:00100000:0.0:1788305763.031492:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300224 00000100:00100000:0.0:1788305763.031511:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299584 00000100:00100000:0.0:1788305763.031514:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299584 00000100:00100000:0.0:1788305763.031523:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300352 00000100:00100000:0.0:1788305763.031525:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300352 00000100:00100000:0.0:1788305763.031536:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305763.031541:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015300096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031566:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875174015300096:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031571:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305763.031581:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305763.031587:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015300224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031609:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015300224:12345-0@lo:400:kworker.0 Request processed in 23us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031614:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305763.031623:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305763.031629:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015299584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031650:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015299584:12345-0@lo:400:kworker.0 Request processed in 22us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031656:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305763.031666:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305763.031672:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015300352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031720:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015300352:12345-0@lo:400:kworker.0 Request processed in 48us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.031726:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1788305763.031761:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305763.031764:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305763.031775:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015299840:0@lo:8:kworker.0 00000100:00100000:0.0:1788305763.031802:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.031817:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015299968:0@lo:8:kworker.0 00000100:00100000:0.0:1788305763.031834:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788305763.031876:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e01f80 x1875174015299584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.031888:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015299584:0@lo:400:kworker.0 00010000:00080000:0.0:1788305763.031897:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184026a00 x1875174015300352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.031904:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015300352:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031913:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015299456:0@lo:400:kworker.0 00010000:00080000:0.0:1788305763.031921:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184025500 x1875174015300224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.031928:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015300224:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031958:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015299328:0@lo:400:kworker.0 00010000:00080000:0.0:1788305763.031968:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024700 x1875174015300096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.031974:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875174015300096:0@lo:400:kworker.0 00000100:00100000:0.0:1788305763.031993:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015299712:0@lo:400:kworker.0 00000100:00100000:3.0:1788305763.032097:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299840 00000100:00100000:3.0:1788305763.032102:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299840 00000100:00100000:3.0:1788305763.032128:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015299968 00000100:00100000:3.0:1788305763.032131:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015299968 00000100:00100000:3.0:1788305763.032141:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305763.032146:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875174015299840:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788305763.032171:0:18658:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:3.0:1788305763.032197:0:18658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e60548a7 00002000:00100000:3.0:1788305763.032210:0:18658:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff88918665b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788305763.032213:0:18658:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788305763.032216:0:18658:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305763.032388:0:18658:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788305763.032410:0:18658:0:(import.c:65:import_set_state_nolock()) ffff8891834d4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305763.032447:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015299840:12345-0@lo:8:kworker.0 Request processed in 300us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305763.032453:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788305763.032465:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305763.032469:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875174015299968:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788305763.032479:0:18658:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788305763.035864:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024380 x1875174015299840/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305783 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.035878:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788305763.035888:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788305763.035895:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788305763.035901:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788305763.035904:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88908273a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788305763.035925:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788305763.035930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015299840:0@lo:8:kworker.0 00000004:00080000:0.0:1788305763.035998:0:17893:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788305763.036018:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300608:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788305763.036077:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.036105:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac000 going to sleep for 11 seconds 00000004:00080000:0.0:1788305763.036121:0:17892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788305763.036218:0:17892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 593126942574ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788305763.036225:0:17892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788305763.036446:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305763.036459:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015300480:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305763.036489:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.036526:0:18661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788305763.036533:0:18661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788305763.036645:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300608 00000100:00100000:0.0:1788305763.036652:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300608 00000100:00080000:0.0:1788305763.036708:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305763.036780:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788305763.036789:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1875174015300608:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788305763.037185:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300480 00000100:00100000:1.0:1788305763.037190:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300480 00000100:00100000:1.0:1788305763.037221:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305763.037229:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875174015300480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305763.037248:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305763.037321:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3648:x1875174015300480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305763.037327:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788305763.037364:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024380 x1875174015300480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305763.037381:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015300480:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1788305763.046327:0:18928:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788305763.046337:0:18928:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788305763.046431:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17893:x1875174015300608:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9637us (10348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.046443:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788305763.046503:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024700 x1875174015300608/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305779 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.046518:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300608:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788305763.046532:0:17893:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788305763.046574:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300736:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788305763.046609:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.046631:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305763.046651:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300736 00000100:00100000:0.0:1788305763.046657:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300736 00000100:00100000:0.0:1788305763.046697:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788305763.046719:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1875174015300736:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788305763.046745:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788305763.046777:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1875174015300736:12345-0@lo:5:osp-pre-0-1.0 Request processed in 59us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305763.046784:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788305763.046807:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024700 x1875174015300736/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305779 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305763.046817:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300736:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788305763.046825:0:17893:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788305763.046848:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300864:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788305763.046878:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305763.046891:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90ac000 going to sleep for 11 seconds 00000100:00100000:0.0:1788305763.046903:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300864 00000100:00100000:0.0:1788305763.046906:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300864 00000100:00100000:0.0:1788305763.046922:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788305763.046928:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17893:x1875174015300864:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788305763.046950:0:18661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:2.0:1788305763.048145:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788305763.055120:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3646:x1875174015299968:12345-0@lo:8:kworker.0 Request processed in 22640us (23276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788305763.055135:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788305763.055198:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788305763.055203:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788305763.055207:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015299968:0@lo:8:kworker.0 00000001:00080000:0.0:1788305763.074918:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788305763.074934:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788305763.075289:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17893:x1875174015300864:12345-0@lo:5:osp-pre-0-1.0 Request processed in 28338us (28388us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788305763.075300:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788305763.075437:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184024700 x1875174015300864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305779 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305763.075450:0:17893:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788305763.075469:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17893:1875174015300864:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788305763.075488:0:17893:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788305763.075539:0:17893:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1875174015300992:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788305763.075578:0:17893:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305763.075612:0:17893:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182f61f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305763.077431:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015300992 00000100:00100000:3.0:1788305763.077444:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015300992 00000100:00100000:3.0:1788305763.077504:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788305763.077515:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1875174015300992:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788305763.077614:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17893:x1875174015300992:12345-0@lo:900:osp-pre-0-1.0 Request processed in 101us (2035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305763.077621:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788305763.077667:0:17893:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083f1f100 x1875174015300992/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305779 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305763.078013:0:17893:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17893:1875174015300992:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788305763.876971:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305764.054448:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305744/real 1788305744] req@ffff8891bb229f80 x1875174015290496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305764.054481:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb229f80 x1875174015290496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305764.054490:0:3646:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788305744/real 1788305744] req@ffff8891bb22a680 x1875174015290624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305764 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305764.054499:0:3646:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8891bb22a680 x1875174015290624/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788305764 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788305764.054516:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305764.054543:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305764.054547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015290496:0@lo:8:kworker.0 00000100:00080000:0.0:1788305764.054552:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788305764.054556:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788305764.054559:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015290624:0@lo:8:kworker.0 00000100:00080000:1.0:1788305764.054720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305764.054725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788305764.054735:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305764.054740:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1788305764.054745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305764.054751:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8891844f9000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305764.054772:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1e300 x1875174015301376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305764.054786:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305764.054789:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305764.054791:0:8:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305764.054794:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1788305764.054797:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305764.054800:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305764.054811:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1c000 x1875174015301504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305764.054837:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305764.054840:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305764.054842:0:8:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305764.054845:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 593 00000100:00080000:1.0:1788305764.054848:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788305764.054851:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305764.054860:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083f1df80 x1875174015302016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305764.054905:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015301248:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.054971:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055009:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015302144:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055036:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055057:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788305764.055062:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015301632:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055082:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055096:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015302272:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055146:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301248 00000100:00100000:1.0:1788305764.055152:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301248 00000100:00100000:1.0:1788305764.055194:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305764.055203:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015301248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055252:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015301248:12345-0@lo:400:kworker.0 Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.055259:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305764.055306:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302144 00000100:00100000:1.0:1788305764.055310:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302144 00000100:00100000:1.0:1788305764.055333:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301632 00000100:00100000:1.0:1788305764.055336:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301632 00000100:00100000:1.0:1788305764.055345:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302272 00000100:00100000:1.0:1788305764.055347:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302272 00000100:00100000:1.0:1788305764.055359:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305764.055365:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015302144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055392:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015302144:12345-0@lo:400:kworker.0 Request processed in 28us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.055398:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788305764.055408:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305764.055413:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015301632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055449:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1875174015301632:12345-0@lo:400:kworker.0 Request processed in 35us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.055455:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788305764.055468:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305764.055474:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015302272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.055499:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015302272:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.055505:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788305764.055523:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015301376:0@lo:8:kworker.0 00000100:00100000:1.0:1788305764.055549:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055574:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015301504:0@lo:8:kworker.0 00000100:00100000:1.0:1788305764.055598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055615:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015302016:0@lo:8:kworker.0 00000100:00100000:1.0:1788305764.055634:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.055663:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301376 00000100:00100000:1.0:1788305764.055667:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301376 00000100:00100000:0.0:1788305764.055985:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015301120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.056023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.056047:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015301888:0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.056065:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.063980:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305764.064001:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015301760:0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.064071:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.064096:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015302400:0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.064124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.064174:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302400 00000100:00100000:0.0:1788305764.064183:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302400 00000100:00100000:0.0:1788305764.064230:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305764.064239:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015302400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.064311:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015302400:12345-0@lo:400:kworker.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305764.064318:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788305764.064352:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301760 00000100:00100000:0.0:1788305764.064356:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301760 00000100:00100000:0.0:1788305764.064390:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788305764.064398:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015301760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305764.064431:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015301760:12345-0@lo:400:kworker.0 Request processed in 34us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305764.064438:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788305764.064886:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301504 00000100:00100000:1.0:1788305764.064892:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301504 00000100:00100000:1.0:1788305764.064919:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302016 00000100:00100000:1.0:1788305764.064923:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302016 00000100:00100000:1.0:1788305764.064937:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301888 00000100:00100000:1.0:1788305764.064939:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301888 00000100:00100000:1.0:1788305764.064959:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305764.064966:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015301888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.065008:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015301888:12345-0@lo:400:kworker.0 Request processed in 43us (8941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.065015:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788305764.065042:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305764.065047:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015301376:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788305764.065072:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 594 last 0 00000020:00000080:1.0:1788305764.065100:0:18660:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e60548ae 00002000:00100000:1.0:1788305764.065115:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8891a7e6c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788305764.065118:0:18660:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788305764.065121:0:18660:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788305764.065195:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305764.065218:0:18660:0:(import.c:65:import_set_state_nolock()) ffff8891a7e6a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305764.065259:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015301376:12345-0@lo:8:kworker.0 Request processed in 210us (9709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.065265:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305764.065296:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305764.065300:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015302016:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305764.065310:0:18660:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305764.065338:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015302016:12345-0@lo:8:kworker.0 Request processed in 35us (9702us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305764.065343:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788305764.065387:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083f1f100 x1875174015301632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.065401:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3649:1875174015301632:0@lo:400:kworker.0 00010000:00080000:1.0:1788305764.065415:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083e66680 x1875174015302272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.065422:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015302272:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.065445:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015301248:0@lo:400:kworker.0 00010000:00080000:1.0:1788305764.065456:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889184db7800 x1875174015302144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.065464:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184db7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015302144:0@lo:400:kworker.0 00010000:00080000:1.0:1788305764.065501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083f1e300 x1875174015301376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.065509:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305764.065515:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788305764.065522:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788305764.065528:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788305764.065530:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891844f9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788305764.065552:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788305764.065557:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015301376:0@lo:8:kworker.0 00000100:00080000:1.0:1788305764.065569:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305764.065573:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305764.065576:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015302016:0@lo:8:kworker.0 00000004:00080000:1.0:1788305764.065620:0:17176:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788305764.065639:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17176:1875174015302656:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788305764.065670:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.065709:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788305764.065722:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302656 00000100:00100000:1.0:1788305764.065726:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302656 00000100:00100000:1.0:1788305764.065762:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788305764.065769:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17176:x1875174015302656:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788305764.066006:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788305764.066011:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875174015301504:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305764.066024:0:18661:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305764.066060:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3646:x1875174015301504:12345-0@lo:8:kworker.0 Request processed in 47us (10461us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305764.066067:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788305764.066092:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305764.066097:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305764.066100:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015301504:0@lo:8:kworker.0 00000100:00100000:1.0:1788305764.066157:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015301120 00000100:00100000:1.0:1788305764.066161:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015301120 00000100:00100000:1.0:1788305764.066189:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788305764.066196:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3648:x1875174015301120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.066228:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3648:x1875174015301120:12345-0@lo:400:kworker.0 Request processed in 33us (10205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.066298:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788305764.066470:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305764.066480:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788305764.066490:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015302528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305764.066518:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305764.066545:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302528 00000100:00100000:1.0:1788305764.066549:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302528 00000100:00100000:1.0:1788305764.066575:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305764.066582:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015302528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305764.066594:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305764.066653:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875174015302528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305764.066659:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788305764.066853:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083e66680 x1875174015302528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.066871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015302528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305764.066898:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015301760:0@lo:400:kworker.0 00010000:00080000:1.0:1788305764.066911:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083e65f80 x1875174015302400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.066920:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015302400:0@lo:400:kworker.0 00000100:00100000:1.0:1788305764.066929:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015301120:0@lo:400:kworker.0 00010000:00080000:1.0:1788305764.066939:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083f1dc00 x1875174015301888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788305780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305764.066947:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015301888:0@lo:400:kworker.0 00000004:00080000:2.0:1788305764.069981:0:17175:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788305764.070088:0:17175:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 594160812212ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788305764.070104:0:17175:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:3.0:1788305764.072868:0:18660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788305764.072878:0:18660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788305764.072883:0:18660:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:1.0:1788305764.073318:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788305764.102164:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.102176:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.102213:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.102218:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.102225:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.102244:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.102254:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.102261:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.102309:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788305764.103174:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.103183:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103193:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.103197:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.103201:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103211:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103229:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103236:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103254:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305764.103264:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305764.103269:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103305:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305764.103310:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103320:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103338:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103344:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548b5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103359:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305764.103367:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103374:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305764.103387:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103394:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103404:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103410:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548bc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.103420:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.103422:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.103423:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.104318:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.104326:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.104337:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.104340:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.104345:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.104369:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.104388:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.104396:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.104435:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.105343:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305764.105580:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305764.105587:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305764.105598:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305764.105603:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305764.105613:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305764.105641:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305764.105649:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e60548c3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305764.105669:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305764.105671:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305764.105673:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305764.105857:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305764.105864:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.105880:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788305764.105884:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305764.105889:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.105902:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.105910:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.105916:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.105934:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305764.110129:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305764.110148:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110168:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788305764.110174:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305764.110181:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110196:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110216:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110224:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110251:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305764.110266:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305764.110289:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110298:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.110303:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110312:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110328:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110335:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000367614ca/0x4a426866e60548ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110351:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.110359:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110365:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.110368:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110376:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110387:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110394:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.110406:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.110408:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.110410:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.111075:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.112452:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.112465:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.112482:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.112486:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.112493:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.112505:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.112515:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.112523:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.112552:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305764.112583:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.112591:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.112598:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.112603:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.112621:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.112636:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.112643:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddaa25ed/0x4a426866e60548d8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.112659:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.112661:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.112663:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.113075:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.113082:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113091:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.113094:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.113098:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113108:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113115:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113121:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113144:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788305764.113460:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.113466:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113475:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.113483:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.113488:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113498:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113506:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113513:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.113532:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788305764.113534:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305764.113540:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113559:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305764.113563:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113571:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113586:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113594:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f49e4fd8/0x4a426866e60548df lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113609:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305764.113612:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113619:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305764.113622:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113629:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113638:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113662:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000876502d7/0x4a426866e60548e6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.113675:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.113677:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.113892:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.114043:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.114049:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.114058:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.114061:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.114065:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.114074:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.114082:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.114095:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.115525:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.115536:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.115547:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.115551:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.115559:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.115575:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.115596:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788305764.115599:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.115601:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.115601:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918f8a09/0x4a426866e60548ed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.115602:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.115659:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305764.119241:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305764.119258:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.119296:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=594s v=(0 0) 00010000:00010000:3.0:1788305764.119300:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305764.119307:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.119321:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.119330:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.119336:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.119356:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305764.119661:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305764.119669:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.119677:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305764.119682:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.119701:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.119721:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.119728:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2995238/0x4a426866e60548f4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.119746:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.119755:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.119757:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.124855:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.124868:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.124886:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.124891:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.124897:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.124911:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.124922:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.124930:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.124956:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305764.125025:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.125034:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.125051:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.125056:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.125064:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.125079:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.125085:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cddc9fbd/0x4a426866e60548fb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.125104:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.125105:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.125107:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.126353:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.126365:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126379:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.126382:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.126388:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126411:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126420:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126428:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126445:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305764.126455:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305764.126460:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126467:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305764.126471:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126479:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126493:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126501:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce402cd2/0x4a426866e6054902 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.126524:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.126526:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305764.126527:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.127192:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.127199:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.127208:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.127211:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.127216:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.127225:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.127233:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.127240:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.127259:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788305764.128038:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.128046:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128068:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.128072:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.128077:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128087:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128095:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128102:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128129:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788305764.128423:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305764.128431:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128440:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305764.128444:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128453:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128470:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128477:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bec061e7/0x4a426866e6054909 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128495:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305764.128499:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128512:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305764.128515:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128522:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128532:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128539:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054cc921d/0x4a426866e6054910 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.128551:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.128552:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.128554:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.128563:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.128569:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128577:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.128580:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.128584:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128595:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128613:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128621:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.128639:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305764.128670:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.128677:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.128702:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.128706:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.128713:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.128731:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.128739:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67ba84f/0x4a426866e6054917 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.128752:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.128754:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.128755:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.128885:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.128999:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.129005:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129013:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.129016:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.129020:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129029:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129035:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129042:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129072:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305764.129110:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.129116:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129123:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eac00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.129126:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129134:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129145:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129152:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024b9c9c5/0x4a426866e605491e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129177:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.129178:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.129180:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.129386:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.129392:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129401:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.129405:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.129409:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129418:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129426:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129433:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129506:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305764.129513:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305764.129517:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.129525:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebc00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305764.129528:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.129547:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.129558:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.129565:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003374892c/0x4a426866e6054925 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305764.129579:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.129581:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305764.129582:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.129814:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.129820:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129829:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.129838:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.129842:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129852:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129860:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129866:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.129885:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788305764.129949:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.129954:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129962:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.129965:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129973:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129985:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.129991:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e38b294/0x4a426866e605492c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.130005:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.130007:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.130009:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788305764.130297:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.130303:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130312:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.130315:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.130320:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130329:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130336:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130350:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130363:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788305764.130736:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.130751:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130760:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.130763:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.130768:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130777:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130784:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130792:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.130808:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788305764.131053:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.131058:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.131071:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.131074:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.131078:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.131087:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.131094:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.131102:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.131109:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788305764.132024:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.132033:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132043:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.132046:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.132051:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132061:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132081:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132088:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132096:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788305764.132485:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.132492:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132500:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.132503:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.132507:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132516:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132524:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132531:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132549:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1788305764.132799:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.132805:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132814:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.132817:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.132821:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132829:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132837:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132844:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.132851:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1788305764.133048:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.133053:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133061:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.133068:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.133073:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133082:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133089:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133096:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133103:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1788305764.133383:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.133389:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133397:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.133399:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.133403:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133412:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133420:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133432:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133440:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1788305764.133898:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788305764.133904:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133913:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=594s v=(0 0) 00010000:00010000:2.0:1788305764.133916:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788305764.133919:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133928:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133935:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133942:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305764.133950:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00080000:2.0:1788305764.133978:0:18660:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788305764.134082:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17176:x1875174015302656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68310us (68407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305764.134103:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788305764.134249:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788305764.134257:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134291:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134295:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134304:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134321:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134327:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b1d9dfe/0x4a426866e6054933 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134350:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788305764.134354:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134360:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eae00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134363:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134370:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134378:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134391:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f85461d1/0x4a426866e605493a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134404:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788305764.134408:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134414:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eaa00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134416:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134424:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134433:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134439:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2fdf8d/0x4a426866e6054941 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134451:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788305764.134454:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134460:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134468:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134475:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134484:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134490:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce732c6/0x4a426866e6054948 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134503:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788305764.134506:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134511:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134514:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134520:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134528:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134535:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3c16b4b/0x4a426866e605494f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134551:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788305764.134555:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134561:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134565:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134572:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134581:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134587:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d78b6a7/0x4a426866e6054956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134598:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788305764.134601:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134606:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134610:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134627:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134636:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134644:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2307468/0x4a426866e605495d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134654:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305764.134657:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134663:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134666:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134673:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134953:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134961:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b28352/0x4a426866e6054964 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134985:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305764.134989:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.134995:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305764.134998:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.135004:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.135013:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.135020:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e26312c/0x4a426866e605496b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305764.135030:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.135031:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305764.135033:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305764.135767:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17176:1875174015302656:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788305764.135788:0:17176:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788305764.135842:0:17176:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17176:1875174015302784:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788305764.135905:0:17176:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305764.135934:0:17176:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083caaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305764.136030:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302784 00000100:00100000:2.0:1788305764.136036:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302784 00000100:00100000:2.0:1788305764.136090:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788305764.136099:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17176:x1875174015302784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788305764.136135:0:18661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:0.0:1788305764.136369:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788305764.146411:0:18655:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788305764.146463:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788305764.146899:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17176:x1875174015302784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10795us (10988us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788305764.146909:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305764.146999:0:17176:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788305764.147008:0:17176:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17176:1875174015302784:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788305764.147026:0:17176:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:3.0:1788305764.310796:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015302912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305764.310871:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.311601:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015302912 00000100:00100000:0.0:1788305764.311611:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015302912 00000100:00100000:0.0:1788305764.311648:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305764.311656:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015302912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305764.311699:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305764.311754:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015302912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305764.311775:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788305764.311819:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015302912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305764.312723:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015303040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305764.312771:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305764.312954:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303040 00000100:00100000:0.0:1788305764.312964:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303040 00000100:00100000:0.0:1788305764.313010:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305764.313018:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015303040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305764.313049:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305764.313093:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015303040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305764.313099:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788305764.313132:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015303040:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788305764.908543:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788305764.912071:0:19025:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788305765.913445:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305765.930140:0:19077:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305765.930378:0:19077:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788305766.940607:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305767.086863:0:19127:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305767.087150:0:19127:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788305767.957625:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305768.405628:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305768.405665:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015303168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305768.405738:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305768.405808:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303168 00000100:00100000:1.0:1788305768.405815:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303168 00000100:00100000:1.0:1788305768.405869:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305768.405879:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015303168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305768.405912:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305768.405956:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015303168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305768.405963:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788305768.405984:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305768.406025:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015303168:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788305768.982033:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788305769.429772:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305769.429779:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305769.429783:0:38:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305769.429792:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 594 00000100:00080000:0.0:1788305769.429797:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788305769.429803:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305769.429824:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891b8e01c00 x1875174015303808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788305769.429857:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788305769.429861:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788305769.429862:0:38:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788305769.429866:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 594 00000100:00080000:0.0:1788305769.429868:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788305769.429872:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:0.0:1788305769.429883:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083d15c00 x1875174015304320/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788305769.429979:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015303296:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305769.430042:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430093:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015303936:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430124:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430141:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015304576:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430183:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788305769.430189:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015303680:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430210:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430232:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015304448:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430301:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015303424:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430347:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430371:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015304064:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430853:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015304704:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430878:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.430898:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788305769.430903:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015303552:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.430924:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305769.431035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015304960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305769.431065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305769.431102:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304960 00000100:00100000:3.0:1788305769.431109:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304960 00000100:00100000:3.0:1788305769.431159:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788305769.431167:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015304960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305769.431188:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305769.431229:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015304960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305769.431236:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788305769.431254:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305769.431306:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015304960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305769.433751:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015304192:0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.433810:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.433829:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015304832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305769.433853:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305769.433929:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303296 00000100:00100000:2.0:1788305769.433938:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303296 00000100:00100000:0.0:1788305769.434801:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015303808:0@lo:8:kworker.0 00000100:00100000:0.0:1788305769.434839:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.434870:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015304320:0@lo:8:kworker.0 00000100:00100000:0.0:1788305769.434902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305769.434943:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304064 00000100:00100000:0.0:1788305769.434949:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304064 00000100:00100000:0.0:1788305769.434982:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303552 00000100:00100000:0.0:1788305769.434986:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303552 00000100:00100000:0.0:1788305769.434997:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304832 00000100:00100000:0.0:1788305769.435000:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304832 00000100:00100000:0.0:1788305769.435014:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305769.435022:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015304064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.435080:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1875174015304064:12345-0@lo:400:kworker.0 Request processed in 58us (4296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305769.435088:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788305769.435106:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305769.435112:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015303552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305769.435139:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015303552:12345-0@lo:400:kworker.0 Request processed in 28us (4215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305769.435145:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788305769.435155:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305769.435161:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015304832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305769.435184:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305769.435211:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015304832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305769.435216:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788305769.435233:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303936 00000100:00100000:0.0:1788305769.435236:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303936 00000100:00100000:0.0:1788305769.435252:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304576 00000100:00100000:0.0:1788305769.435254:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304576 00000100:00100000:0.0:1788305769.435291:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304448 00000100:00100000:0.0:1788305769.435300:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304448 00000100:00100000:0.0:1788305769.435315:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304704 00000100:00100000:0.0:1788305769.435317:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304704 00000100:00100000:0.0:1788305769.435330:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305769.435335:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015303936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.435751:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303680 00000100:00100000:1.0:1788305769.435757:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303680 00000100:00100000:1.0:1788305769.435855:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304192 00000100:00100000:1.0:1788305769.435859:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304192 00000100:00100000:1.0:1788305769.435873:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303808 00000100:00100000:1.0:1788305769.435876:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303808 00000100:00100000:1.0:1788305769.435884:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015304320 00000100:00100000:1.0:1788305769.435886:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015304320 00000100:00100000:1.0:1788305769.435895:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305769.435901:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015303680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.435943:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015303680:12345-0@lo:400:kworker.0 Request processed in 43us (5732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.435949:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788305769.435960:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305769.435965:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015304192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.435986:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015304192:12345-0@lo:400:kworker.0 Request processed in 21us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.436077:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788305769.436090:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305769.436095:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015303808:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305769.436113:0:18660:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305769.436146:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015303808:12345-0@lo:8:kworker.0 Request processed in 50us (1306us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305769.436152:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305769.436161:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305769.436164:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015304320:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788305769.436172:0:18660:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788305769.436200:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3646:x1875174015304320:12345-0@lo:8:kworker.0 Request processed in 35us (1298us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788305769.436205:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788305769.436237:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305769.436241:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305769.436245:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015303808:0@lo:8:kworker.0 00000100:00080000:1.0:1788305769.436252:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305769.436255:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788305769.436258:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015304320:0@lo:8:kworker.0 00000100:00100000:1.0:1788305769.438786:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015303424 00000100:00100000:1.0:1788305769.438800:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015303424 00000100:00100000:1.0:1788305769.438851:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788305769.438859:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:3649:x1875174015303424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.438933:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+21:3649:x1875174015303424:12345-0@lo:400:kworker.0 Request processed in 75us (8585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.438940:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788305769.438976:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305769.438984:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015304576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.439024:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015304576:12345-0@lo:400:kworker.0 Request processed in 41us (8863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.439030:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788305769.439043:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305769.439048:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015304448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.439071:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015304448:12345-0@lo:400:kworker.0 Request processed in 23us (8818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.439085:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305769.439096:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788305769.439102:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015304704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.439125:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015304704:12345-0@lo:400:kworker.0 Request processed in 24us (8247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.439130:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788305769.440985:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305769.440990:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305769.441053:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015303680:0@lo:400:kworker.0 00010000:00080000:3.0:1788305769.441073:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083d16a00 x1875174015304448/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305769.441083:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015304448:0@lo:400:kworker.0 00010000:00080000:3.0:1788305769.441100:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083d15f80 x1875174015304576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305769.441116:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015304576:0@lo:400:kworker.0 00000100:00100000:3.0:1788305769.441198:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305769.441206:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015303296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305769.441235:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788305769.441323:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015303296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (11279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305769.441340:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305769.441377:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015303296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305769.443201:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015303552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305769.443220:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015304192:0@lo:400:kworker.0 00000100:00100000:2.0:1788305769.443238:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015304832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305769.443249:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015303424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305769.443293:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015304064:0@lo:400:kworker.0 00010000:00080000:2.0:1788305769.443317:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083d16680 x1875174015304704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305769.443328:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015304704:0@lo:400:kworker.0 00000100:00100000:1.0:1788305769.444485:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015303936:12345-0@lo:400:kworker.0 Request processed in 9141us (14352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305769.444498:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788305769.445368:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e02680 x1875174015303936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305769.445384:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015303936:0@lo:400:kworker.0 00010000:00010000:3.0:1788305770.013004:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305770.264915:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788305771.031992:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305771.542058:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788305772.058344:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305773.084764:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305773.525643:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788305773.525665:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015305088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305773.525732:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305773.525820:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305088 00000100:00100000:2.0:1788305773.525828:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305088 00000100:00100000:2.0:1788305773.525885:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305773.525895:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015305088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305773.525925:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305773.525973:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015305088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305773.525980:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305773.526021:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015305088:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788305773.526047:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:3.0:1788305773.985880:0:19472:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788305773.985884:0:19472:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788305773.985886:0:19472:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788305773.986117:0:19472:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff88908353f800 00000020:01000004:3.0:1788305773.986132:0:19472:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788305773.986147:0:19472:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788305773.986159:0:19472:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8891bdc43370) 00000020:00000080:3.0:1788305773.986176:0:19472:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1788305774.101694:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788305774.122680:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788305774.125549:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788305774.126045:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788305774.126861:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788305774.127134:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788305774.127670:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788305774.128960:0:19472:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788305774.135795:0:19472:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788305774.136026:0:19472:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788305774.136042:0:19472:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788305774.136056:0:19472:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e6054979 00000020:01000004:0.0:1788305774.136063:0:19472:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788305774.136085:0:19472:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.155@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788305774.136089:0:19472:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.155@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788305774.136094:0:19472:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788305774.136123:0:19472:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788305774.136127:0:19472:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.155@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788305774.155969:0:19472:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.155@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788305774.156009:0:19472:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.155@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788305774.156014:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788305774.156016:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305774.156017:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305774.156018:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305774.156019:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305774.156021:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305774.156023:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305774.156025:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305774.156031:0:19472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305774.156035:0:19472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788305774.156037:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305774.156038:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305774.156039:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305774.156040:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305774.156040:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305774.156041:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305774.156042:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305774.156043:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305774.156043:0:19472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788305774.156069:0:19472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788305774.156087:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305216:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788305774.156174:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.156348:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff889182be7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.159622:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305216 00000100:00100000:1.0:1788305774.159640:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305216 00000100:00100000:1.0:1788305774.159718:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788305774.159730:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:19472:x1875174015305216:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788305774.159769:0:17147:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788305774.159773:0:17147:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788305774.159777:0:17147:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788305774.160333:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:19472:x1875174015305216:12345-0@lo:253:mount.lustre.0 Request processed in 604us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.160342:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788305774.160610:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305216:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788305774.160627:0:19472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788305774.160631:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788305774.160632:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305774.160634:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305774.160635:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305774.160636:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305774.160638:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305774.160639:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305774.160641:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305774.160642:0:19472:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788305774.160663:0:19472:0:(tgt_mount.c:101:server_register_mount()) register mount ffff88908353f800 from lustre-OST0001 10000000:01000000:3.0:1788305774.160694:0:19472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788305774.160697:0:19472:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788305774.160706:0:19472:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8891bb4f4d28 local copy 00010000:00010000:3.0:1788305774.160717:0:19472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305774.160841:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.160894:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.160934:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.161030:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305344 00000100:00100000:1.0:1788305774.161035:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305344 00000100:00100000:1.0:1788305774.161075:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788305774.161083:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:19472:x1875174015305344:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305774.161165:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:19472:x1875174015305344:12345-0@lo:501:mount.lustre.0 Request processed in 83us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305774.161172:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788305774.161571:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305344:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788305774.161587:0:19472:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.155@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788305774.161620:0:19472:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.155@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788305774.161626:0:19472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.161635:0:19472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51200/0x4a426866e60545cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60545d6 expref: -99 pid: 17131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305774.161661:0:19472:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff88908353f800 10000000:01000000:3.0:1788305774.161666:0:19472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788305774.161671:0:19472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788305774.161673:0:19472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305774.161678:0:19472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788305774.161681:0:19472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788305774.161702:0:19472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.161710:0:19472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.161718:0:19472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305774.161730:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305774.161759:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.161795:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff88908333b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.162673:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305472 00000100:00100000:1.0:1788305774.162682:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305472 00000100:00100000:1.0:1788305774.162734:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788305774.162742:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:19472:x1875174015305472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788305774.162754:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305774.162768:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51400/0x4a426866e6054987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054980 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.162790:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51400/0x4a426866e6054987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054980 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.162800:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51400/0x4a426866e6054987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054980 expref: 22 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.162808:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51400, rc 0) 00000100:00100000:1.0:1788305774.162867:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305472:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.162874:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788305774.163015:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305774.163029:0:19472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.163038:0:19472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305774.164399:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788305774.165085:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305774.167702:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788305774.167757:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788305774.167774:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788305774.167788:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788305774.167802:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788305774.167813:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788305774.167836:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788305774.167843:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788305774.167944:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.168010:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.168114:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.176725:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305600 00000100:00100000:1.0:1788305774.176741:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305600 00000100:00100000:1.0:1788305774.176858:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788305774.176870:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788305774.177115:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305600:12345-0@lo:501:mount.lustre.0 Request processed in 247us (9104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.177122:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788305774.180849:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.180918:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305774.181015:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.181063:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.181202:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305728 00000100:00100000:2.0:1788305774.181209:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305728 00000100:00100000:2.0:1788305774.181263:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788305774.181290:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788305774.182105:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305728:12345-0@lo:503:mount.lustre.0 Request processed in 831us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.182115:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788305774.183692:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305728:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305774.184770:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305774.184859:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305856:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.184944:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.184995:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.185101:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305856 00000100:00100000:2.0:1788305774.185107:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305856 00000100:00100000:2.0:1788305774.185161:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788305774.185171:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305774.185719:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305856:12345-0@lo:502:mount.lustre.0 Request processed in 547us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.185728:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788305774.186574:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305856:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305774.186829:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788305774.186865:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788305774.186881:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788305774.186893:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788305774.186906:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788305774.186918:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788305774.186931:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788305774.186943:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788305774.186972:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788305774.187010:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305984:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.187068:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.187110:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830700c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.187216:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015305984 00000100:00100000:1.0:1788305774.187223:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015305984 00000100:00100000:1.0:1788305774.187263:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788305774.187295:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305984:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788305774.187655:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015305984:12345-0@lo:502:mount.lustre.0 Request processed in 383us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.187663:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788305774.187791:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015305984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788305774.187837:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788305774.187847:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788305774.189928:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788305774.189938:0:19476:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788305774.189944:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.189946:0:19476:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788305774.189953:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788305774.189967:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8891b9178000) 00000020:00000080:2.0:1788305774.189994:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788305774.190001:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788305774.190100:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908353f800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788305774.190113:0:19476:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788305774.190121:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4a426866e6054995 00010000:00010000:2.0:1788305774.198573:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788305774.199798:0:19476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:2.0:1788305774.206681:0:19476:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788305774.216253:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788305774.216269:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305774.216297:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.216313:0:19476:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788305774.216318:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305774.216322:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.216324:0:19476:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788305774.216327:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788305774.216329:0:19476:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788305774.216331:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305774.216333:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.216334:0:19476:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788305774.216337:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788305774.216339:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.216340:0:19476:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788305774.216344:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788305774.216379:0:19476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788305774.216382:0:19476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788305774.216383:0:19476:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788305774.216386:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788305774.220717:0:19472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788305774.220761:0:19472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788305774.220780:0:19472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.220793:0:19472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183564800/0x4a426866e6054980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054987 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305774.220802:0:19472:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88908353f800 from 1 10000000:01000000:3.0:1788305774.220805:0:19472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788305774.220847:0:19472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.220855:0:19472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.220866:0:19472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305774.220889:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305774.220951:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.220988:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8890830700c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.221023:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306112 00000100:00100000:3.0:1788305774.221029:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306112 00000100:00100000:3.0:1788305774.221074:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788305774.221083:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:19472:x1875174015306112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305774.221095:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305774.221107:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e605499c expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.221130:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e605499c expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.221139:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605499c expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.221166:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183565a00, rc 0) 00000100:00100000:3.0:1788305774.221201:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306112:12345-0@lo:101:mount.lustre.0 Request processed in 119us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.221208:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788305774.221262:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305774.221302:0:19472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.221311:0:19472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305774.222642:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788305774.222905:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305774.223074:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788305774.223099:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788305774.223132:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788305774.223139:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788305774.223732:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.223799:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.223888:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070840 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.229649:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306240 00000100:00100000:2.0:1788305774.229669:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306240 00000100:00100000:3.0:1788305774.237028:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788305774.237045:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.237259:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306240:12345-0@lo:501:mount.lustre.0 Request processed in 218us (13458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.237267:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788305774.239866:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788305774.239934:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788305774.240011:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.241123:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.244801:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306368 00000100:00100000:1.0:1788305774.244818:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306368 00000100:00100000:1.0:1788305774.244893:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788305774.244905:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305774.245090:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306368:12345-0@lo:503:mount.lustre.0 Request processed in 187us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.245098:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788305774.245345:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306368:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788305774.245806:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788305774.245899:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305774.245949:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.247104:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.252552:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306496 00000100:00100000:3.0:1788305774.252569:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306496 00000100:00100000:3.0:1788305774.252666:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788305774.252678:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306496:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.252864:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306496:12345-0@lo:502:mount.lustre.0 Request processed in 186us (6913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.252882:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788305774.252984:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305774.253261:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788305774.253375:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788305774.253394:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788305774.253407:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788305774.253421:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788305774.253434:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788305774.253447:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788305774.253461:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788305774.253475:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788305774.253488:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788305774.253501:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788305774.253546:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305774.253592:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.253636:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891834ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.253889:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306624 00000100:00100000:3.0:1788305774.253894:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306624 00000100:00100000:3.0:1788305774.253922:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788305774.253928:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.254021:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306624:12345-0@lo:502:mount.lustre.0 Request processed in 93us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.254028:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788305774.254109:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305774.254165:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788305774.254174:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788305774.257433:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305774.257448:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257450:0:19480:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788305774.257457:0:19480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88908353f800 00000020:00000080:3.0:1788305774.257460:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305774.257467:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305774.257470:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257471:0:19480:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788305774.257473:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305774.257476:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257477:0:19480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788305774.257479:0:19480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff88908353f800 00000020:00000080:3.0:1788305774.257481:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305774.257543:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305774.257548:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257549:0:19480:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788305774.257551:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305774.257554:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257555:0:19480:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305774.257558:0:19480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88908353f800 00000020:00000080:3.0:1788305774.257560:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305774.257577:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305774.257594:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257605:0:19480:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788305774.257609:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788305774.257612:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257613:0:19480:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788305774.257616:0:19480:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff88908353f800 00000020:00000080:3.0:1788305774.257618:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788305774.257644:0:19480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788305774.257647:0:19480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788305774.257648:0:19480:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788305774.257651:0:19480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788305774.257709:0:19472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788305774.257739:0:19472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788305774.257755:0:19472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.257767:0:19472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305774.257821:0:19472:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788305774.257824:0:19472:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff88908353f800 10000000:01000000:3.0:1788305774.257827:0:19472:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff88908353f800 10000000:01000000:3.0:1788305774.257831:0:19472:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788305774.257836:0:19472:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff88908353f800 from 1 10000000:01000000:3.0:1788305774.257839:0:19472:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788305774.257879:0:19472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.257887:0:19472:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.257898:0:19472:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305774.257930:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788305774.257997:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.258032:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff889083070840 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.258053:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306752 00000100:00100000:3.0:1788305774.258059:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306752 00000100:00100000:3.0:1788305774.258095:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788305774.258104:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:19472:x1875174015306752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305774.258118:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305774.258130:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564600/0x4a426866e60549b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60549aa expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.258153:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564600/0x4a426866e60549b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60549aa expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.258162:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564600/0x4a426866e60549b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60549aa expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.258170:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564600, rc 0) 00000100:00100000:3.0:1788305774.258206:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015306752:12345-0@lo:101:mount.lustre.0 Request processed in 102us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.258213:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788305774.258259:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788305774.258302:0:19472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.258312:0:19472:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305774.276194:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:3.0:1788305774.276701:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305774.276902:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788305774.276925:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788305774.276938:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788305774.278398:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788305774.278439:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788305774.278456:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788305774.278471:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788305774.278485:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788305774.278498:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788305774.278512:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788305774.278527:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788305774.278543:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788305774.278559:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788305774.278574:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788305774.278589:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788305774.278618:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788305774.278633:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788305774.278644:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788305774.278655:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788305774.278667:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788305774.278694:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788305774.278709:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788305774.278721:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788305774.278734:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788305774.278746:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788305774.278758:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788305774.278773:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788305774.278784:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788305774.278794:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788305774.278817:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788305774.278828:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788305774.278840:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788305774.278852:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788305774.278866:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788305774.278879:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788305774.278892:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788305774.278919:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788305774.278935:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788305774.278949:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788305774.278961:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788305774.278991:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788305774.279004:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788305774.279016:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788305774.279026:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788305774.279037:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788305774.279048:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788305774.279069:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788305774.281311:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788305774.281433:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.281504:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.281547:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.281594:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015306880 00000100:00100000:3.0:1788305774.281620:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015306880 00000100:00100000:3.0:1788305774.282911:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788305774.282927:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015306880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.283431:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015306880:12345-0@lo:501:mount.lustre.0 Request processed in 508us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.283439:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788305774.283496:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015306880:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788305774.283550:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307008:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788305774.283594:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.283648:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305774.283648:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307008 00000100:00100000:1.0:1788305774.283654:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307008 00000100:00100000:1.0:1788305774.283693:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788305774.283700:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788305774.283789:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307008:12345-0@lo:503:mount.lustre.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.283796:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788305774.285589:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307008:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788305774.286933:0:19472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788305774.287475:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.287563:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.287619:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.288466:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307136 00000100:00100000:2.0:1788305774.288475:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307136 00000100:00100000:2.0:1788305774.288533:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788305774.288543:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305774.288705:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307136:12345-0@lo:502:mount.lustre.0 Request processed in 162us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.288713:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788305774.288801:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305774.289030:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788305774.289060:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788305774.289088:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788305774.289114:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788305774.289127:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788305774.289139:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788305774.289152:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788305774.289165:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788305774.289181:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788305774.289193:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788305774.289205:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788305774.289219:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788305774.289231:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788305774.289245:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788305774.289259:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788305774.289304:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788305774.289324:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788305774.289337:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788305774.289349:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788305774.289360:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788305774.289373:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788305774.289401:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788305774.289416:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788305774.289430:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788305774.289443:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788305774.289455:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788305774.289467:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788305774.289481:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788305774.289494:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788305774.289506:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788305774.289518:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788305774.289529:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788305774.289540:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788305774.289551:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788305774.289562:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788305774.289573:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788305774.289608:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788305774.289637:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788305774.289654:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788305774.289668:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788305774.289680:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788305774.289692:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788305774.289703:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788305774.289715:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788305774.289728:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788305774.289743:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788305774.289754:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788305774.289767:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788305774.289813:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305774.289870:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.289916:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918670b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.289981:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307264 00000100:00100000:2.0:1788305774.289987:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307264 00000100:00100000:2.0:1788305774.290024:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788305774.290033:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788305774.290128:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307264:12345-0@lo:502:mount.lustre.0 Request processed in 95us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.290140:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788305774.292407:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305774.293200:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788305774.293238:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788305774.293351:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788305774.293431:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.293517:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918670b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.297427:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307392 00000100:00100000:3.0:1788305774.297444:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307392 00000100:00100000:3.0:1788305774.298581:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788305774.298605:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788305774.298851:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015307392:12345-0@lo:502:mount.lustre.0 Request processed in 257us (5419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.298859:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788305774.303544:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015307392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788305774.303654:0:19472:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788305774.303669:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788305774.306552:0:19485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788305774.306587:0:19485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8890835799b8) 00000020:00000080:2.0:1788305774.306629:0:19485:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788305774.306717:0:19485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908353f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788305774.306721:0:19485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88908353f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788305774.306724:0:19485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908353f800 3 00010000:00080000:2.0:1788305774.306754:0:19485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889082119000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.155@tcp at head 00010000:00010000:2.0:1788305774.309094:0:19485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788305774.309317:0:19485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788305774.309360:0:19485:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305774.309371:0:19485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4a426866e60549bf 00000100:00080000:2.0:1788305774.309381:0:19485:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305774.309387:0:19485:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff889082119000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305774.309420:0:19485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb22bb80 x1875174015307520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788305774.309440:0:19485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788305774.309473:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015307520:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305774.309563:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788305774.309674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305774.309678:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305774.309680:0:36:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305774.309684:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1788305774.309687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788305774.309691:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305774.309712:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083e65180 x1875174015307904/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788305774.309749:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788305774.309752:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788305774.309754:0:36:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788305774.309757:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1788305774.309759:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788305774.309762:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:1.0:1788305774.309772:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff889083e66a00 x1875174015308416/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788305774.309823:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015307776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.309854:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.309873:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015308544:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.309895:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.309912:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305774.309917:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015307648:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.309938:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.309955:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015308288:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.309984:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.310006:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015308160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310029:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.310044:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310046:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307520 00000100:00100000:2.0:1788305774.310053:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307520 00000100:00100000:1.0:1788305774.310062:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.310080:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308544 00000100:00100000:2.0:1788305774.310084:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308544 00000100:00100000:2.0:1788305774.310104:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308800 00000100:00100000:2.0:1788305774.310106:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308800 00000100:00100000:2.0:1788305774.310130:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305774.310138:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015308544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310192:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184db7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015308544:12345-0@lo:400:kworker.0 Request processed in 54us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.310258:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305774.310414:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788305774.310428:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015308032:0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310451:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788305774.310453:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.310459:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015308800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310464:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015308672:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310482:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.310486:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015308800:12345-0@lo:400:kworker.0 Request processed in 29us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.310492:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788305774.310501:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308032 00010000:00080000:1.0:1788305774.310502:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e00e00 x1875174015308800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305774.310503:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308032 00000100:00100000:2.0:1788305774.310514:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308672 00000100:00100000:1.0:1788305774.310515:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015308800:0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310516:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308672 00000100:00100000:2.0:1788305774.310528:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305774.310534:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015308032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310538:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307776 00000100:00100000:1.0:1788305774.310540:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307776 00000100:00100000:2.0:1788305774.310566:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015308032:12345-0@lo:400:kworker.0 Request processed in 32us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.310566:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308288 00000100:00100000:1.0:1788305774.310568:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308288 00000100:00100000:2.0:1788305774.310572:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788305774.310582:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788305774.310584:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305774.310587:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015308672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310589:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015307776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310625:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015308672:12345-0@lo:400:kworker.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.310625:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015307776:12345-0@lo:400:kworker.0 Request processed in 35us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.310632:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788305774.310632:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788305774.310643:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788305774.310643:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788305774.310647:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3646:x1875174015307520:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788305774.310649:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015308288:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788305774.310667:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000100:00100000:1.0:1788305774.310671:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015308288:12345-0@lo:400:kworker.0 Request processed in 23us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.310676:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:00000080:2.0:1788305774.310695:0:17152:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4a426866e60549c6 00000100:00100000:1.0:1788305774.310701:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015307904:0@lo:8:kworker.0 00000004:00100000:2.0:1788305774.310710:0:17152:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788305774.310723:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.310737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015308416:0@lo:8:kworker.0 00000100:00080000:2.0:1788305774.310738:0:17152:0:(import.c:65:import_set_state_nolock()) ffff889082119800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305774.310755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.310766:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875174015307520:12345-0@lo:38:llog_process_th.0 Request processed in 118us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.310776:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788305774.310781:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb22bb80 x1875174015307520/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305774.310789:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305774.310796:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788305774.310803:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788305774.310803:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788305774.310807:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788305774.310807:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788305774.310809:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305774.310809:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082119000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788305774.310814:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3646:1875174015307520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305774.310824:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015308288:0@lo:400:kworker.0 00000100:00100000:2.0:1788305774.310833:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015307776:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310833:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307904 00000100:00100000:1.0:1788305774.310835:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307904 00010000:00080000:2.0:1788305774.310843:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e02680 x1875174015308544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305774.310847:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308416 00000100:00100000:1.0:1788305774.310849:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308416 00000100:00100000:2.0:1788305774.310852:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015308544:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310857:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305774.310861:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015307904:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788305774.310875:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff889083e67800 x1875174015308032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305774.310882:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015308032:0@lo:400:kworker.0 00010000:00080000:2.0:1788305774.310895:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891b8e01f80 x1875174015308672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305774.310899:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015307904:12345-0@lo:8:kworker.0 Request processed in 37us (175us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788305774.310903:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015308672:0@lo:400:kworker.0 00000100:00100000:1.0:1788305774.310905:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305774.310914:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305774.310918:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015308416:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788305774.310947:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015308416:12345-0@lo:8:kworker.0 Request processed in 26us (190us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788305774.310953:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788305774.311314:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015307648 00000100:00100000:3.0:1788305774.311319:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015307648 00000100:00100000:3.0:1788305774.311355:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308160 00000100:00100000:3.0:1788305774.311358:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308160 00000100:00100000:3.0:1788305774.311372:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305774.311378:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015307648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305774.311422:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015307648:12345-0@lo:400:kworker.0 Request processed in 44us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.311429:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305774.311441:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305774.311447:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015308160:12345-0@lo:400:kworker.0 00000020:01000004:2.0:1788305774.311471:0:19485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788305774.311482:0:19485:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff88908357b370) 00000100:00100000:3.0:1788305774.311492:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015308160:12345-0@lo:400:kworker.0 Request processed in 46us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.311498:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000020:00000080:2.0:1788305774.311499:0:19485:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1788305774.311538:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015307648:0@lo:400:kworker.0 00000100:00100000:3.0:1788305774.311559:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015308160:0@lo:400:kworker.0 00000020:01000004:2.0:1788305774.311571:0:19485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff88908353f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788305774.311575:0:19485:0:(tgt_mount.c:187:server_put_mount()) put mount ffff88908353f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788305774.311577:0:19485:0:(obd_mount.c:710:lustre_put_lsi()) put ffff88908353f800 3 00010000:00080000:2.0:1788305774.311614:0:19485:0:(ldlm_lib.c:102:import_set_conn()) imp ffff889082341000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.155@tcp at head 00000100:00100000:1.0:1788305774.311806:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305774.311811:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305774.311815:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305774.311819:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015307904:0@lo:8:kworker.0 00000100:00100000:1.0:1788305774.311827:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788305774.311835:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788305774.311838:0:3646:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788305774.311841:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083e66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015308416:0@lo:8:kworker.0 00010000:00010000:2.0:1788305774.315844:0:19485:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1788305774.316043:0:19485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788305774.316094:0:19485:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788305774.316107:0:19485:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x4a426866e60549d4 00000100:00080000:2.0:1788305774.316117:0:19485:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788305774.316122:0:19485:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff889082341000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:2.0:1788305774.317225:0:19485:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb22b800 x1875174015308928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788305774.317266:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015308928:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788305774.317352:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.317477:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015308928 00000100:00100000:2.0:1788305774.317484:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015308928 00000100:00100000:2.0:1788305774.317513:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788305774.317521:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3646:x1875174015308928:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788305774.317545:0:18524:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:2.0:1788305774.317586:0:18524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x4a426866e60549db 00000004:00100000:2.0:1788305774.317883:0:18524:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788305774.317917:0:18524:0:(import.c:65:import_set_state_nolock()) ffff889082118800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305774.317967:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875174015308928:12345-0@lo:38:llog_process_th.0 Request processed in 446us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.317975:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788305774.318013:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8891bb22b800 x1875174015308928/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788305784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305774.318023:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788305774.318030:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788305774.318036:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788305774.318041:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788305774.318043:0:3646:0:(import.c:65:import_set_state_nolock()) ffff889082341000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788305774.318054:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3646:1875174015308928:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788305774.318073:0:19485:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1788305774.327725:0:19485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1788305774.328189:0:19472:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788305774.328224:0:19472:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788305774.328252:0:19472:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.328263:0:19472:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183565400/0x4a426866e60549aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549b1 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788305774.328487:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788305774.328489:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305774.328491:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305774.328492:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305774.328493:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305774.328495:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305774.328497:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305774.328499:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305774.328501:0:19472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788305774.328504:0:19472:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788305774.328506:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788305774.328508:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788305774.328509:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788305774.328510:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788305774.328511:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788305774.328512:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788305774.328513:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788305774.328514:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788305774.328515:0:19472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788305774.328541:0:19472:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788305774.328568:0:19472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015309056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788305774.328650:0:19472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.328690:0:19472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa14a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788305774.329711:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309056 00000100:00100000:2.0:1788305774.329722:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309056 00000100:00100000:2.0:1788305774.329780:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788305774.329789:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015309056:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788305774.329817:0:17146:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788305774.329830:0:17146:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788305774.341671:0:17146:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788305774.341690:0:17146:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788305774.341974:0:17167:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788305774.341980:0:17167:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788305774.342001:0:17167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342019:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605488b expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342027:0:17167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054899 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342034:0:17167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342090:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342104:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 24 pid: 17146 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305774.342119:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015309184:0@lo:104: 00000100:00100000:1.0:1788305774.342190:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788305774.342241:0:17167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605488b expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.342250:0:17167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605488b expref: 24 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305774.342304:0:17167:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015309312:0@lo:104: 00000100:00100000:1.0:1788305774.342330:0:17167:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305774.342351:0:17167:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918453b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305774.342481:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309184 00000100:00100000:3.0:1788305774.342490:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309184 00000100:00100000:3.0:1788305774.342525:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309312 00000100:00100000:3.0:1788305774.342529:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309312 00000100:00100000:3.0:1788305774.342544:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305774.342553:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:17167:x1875174015309184:12345-0@lo:104: 00010000:00010000:3.0:1788305774.342566:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342628:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788305774.342634:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e02680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+4:17167:x1875174015309184:12345-0@lo:104: Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.342642:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305774.342657:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305774.342663:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015309312:12345-0@lo:104: 00010000:00010000:3.0:1788305774.342671:0:17135:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342701:0:17135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788305774.342706:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:739dca1e-bd16-46de-8d05-a6337c8af843+3:17167:x1875174015309312:12345-0@lo:104: Request processed in 43us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.342711:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788305774.342726:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305774.342731:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342744:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305774.342748:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342756:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788305774.342763:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305774.342768:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305774.342809:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342817:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305774.342845:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342852:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9000/0x4a426866e6054899 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60548a0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342862:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788305774.342862:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015309440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305774.342865:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342870:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:3.0:1788305774.342873:0:17141:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342889:0:17141:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305774.342892:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788305774.342897:0:17141:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305774.342901:0:17141:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788305774.342918:0:17141:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342924:0:17141:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788305774.342934:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305774.342941:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9200/0x4a426866e605488b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054892 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305774.342942:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788305774.342947:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015309568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305774.342954:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305774.342956:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305774.342957:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305774.342963:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305774.342988:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305774.343013:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:19472:x1875174015309056:12345-0@lo:253:mount.lustre.0 Request processed in 13225us (14362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305774.343022:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788305774.343438:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309440 00000100:00100000:0.0:1788305774.343444:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309440 00010000:00010000:0.0:1788305774.343466:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 24 pid: 17146 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305774.343487:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309568 00000100:00100000:0.0:1788305774.343490:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309568 00010000:00010000:0.0:1788305774.343501:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605488b expref: 25 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305774.343513:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305774.343520:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+25:3649:x1875174015309440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305774.343530:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305774.343535:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 25 pid: 17146 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343545:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 25 pid: 17146 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305774.343549:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e01f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015309184:0@lo:104: 00000100:00100000:1.0:1788305774.343557:0:17167:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891b8e00e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17167:1875174015309312:0@lo:104: 00010000:00010000:0.0:1788305774.343558:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f20400/0x4a426866e60548a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e6054899 expref: 25 pid: 17146 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343570:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305774.343577:0:17167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305774.343607:0:17139:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788305774.343610:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015309440:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305774.343615:0:17139:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788305774.343617:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788305774.343630:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305774.343637:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+23:3649:x1875174015309568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305774.343653:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305774.343657:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605488b expref: 23 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343665:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605488b expref: 23 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343673:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50800/0x4a426866e6054892 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605488b expref: 23 pid: 17145 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343683:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343691:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788305774.343703:0:17138:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011033127s 00010000:00010000:0.0:1788305774.343707:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343715:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343721:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343727:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343732:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305774.343737:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343748:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343768:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.343771:0:17167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305774.343778:0:17167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305774.343778:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305774.343784:0:17167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51800/0x4a426866e60549e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305774.343801:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+22:3649:x1875174015309568:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305774.343807:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305774.343836:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015309568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788305774.343844:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015309440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788305774.345359:0:19472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:739dca1e-bd16-46de-8d05-a6337c8af843:19472:1875174015309056:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788305774.345376:0:19472:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788305774.345379:0:19472:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788305774.345381:0:19472:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788305774.345382:0:19472:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788305774.345384:0:19472:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788305774.345385:0:19472:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788305774.345386:0:19472:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788305774.345387:0:19472:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788305774.345389:0:19472:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788305774.345391:0:19472:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788305774.345406:0:19472:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788305774.349746:0:19472:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788305774.355671:0:19472:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788305774.355681:0:19472:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788305774.355721:0:19472:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788305774.355762:0:19472:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.155@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788305774.355782:0:19472:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788305774.355808:0:19472:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788305774.359111:0:19472:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788305774.360073:0:19472:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788305774.550779:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305774.550804:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015309696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305774.550881:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.550933:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309696 00000100:00100000:2.0:1788305774.550942:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309696 00000100:00100000:2.0:1788305774.550994:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305774.551004:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015309696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305774.551038:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788305774.551099:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015309696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.551107:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788305774.551156:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015309696:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305774.551894:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788305774.551909:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015309824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305774.551949:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305774.552034:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309824 00000100:00100000:0.0:1788305774.552041:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309824 00000100:00100000:0.0:1788305774.552081:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788305774.552090:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015309824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305774.552115:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788305774.552344:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015309952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305774.552388:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305774.552423:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015309952 00000100:00100000:2.0:1788305774.552426:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015309952 00000100:00100000:2.0:1788305774.552451:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305774.552457:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015309952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305774.552471:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305774.552502:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015309952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305774.552509:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788305774.552544:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015309952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788305774.552797:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015309824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 706us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305774.552804:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788305774.555067:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015309824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788305775.126808:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788305775.376843:0:19540:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788305775.378194:0:19540:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788305775.577637:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305775.577645:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff88918c9a0800 from 10 10000000:01000000:3.0:1788305775.577663:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305775.577711:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.577739:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.577751:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305775.577777:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305775.577847:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305775.577888:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305775.581242:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310080 00000100:00100000:3.0:1788305775.581256:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310080 00000100:00100000:3.0:1788305775.581418:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305775.581429:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015310080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305775.581447:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305775.581468:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889183564200/0x4a426866e60549f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60549e9 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.581496:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889183564200/0x4a426866e60549f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60549e9 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.581506:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889183564200/0x4a426866e60549f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60549e9 expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.581515:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889183564200, rc 0) 00000100:00100000:3.0:1788305775.581606:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015310080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305775.581629:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788305775.581689:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305775.581708:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.581718:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305775.581783:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310208:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788305775.581822:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305775.581842:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305775.581856:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310208 00000100:00100000:3.0:1788305775.581860:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310208 00000100:00100000:3.0:1788305775.581884:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305775.581890:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015310208:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788305775.581905:0:17146:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788305775.581922:0:17146:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788305775.581925:0:17146:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788305775.583093:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015310208:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1198us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305775.583104:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788305775.583231:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310208:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788305775.583393:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788305775.583404:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.583425:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183565e00/0x4a426866e60549e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549f0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788305775.583435:0:17149:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788305775.583438:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff889182f56000 from 10 10000000:01000000:3.0:1788305775.583441:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788305775.583468:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.583477:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305775.583485:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305775.583503:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788305775.583534:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305775.583558:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bfa143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305775.584068:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310336 00000100:00100000:1.0:1788305775.584076:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310336 00000100:00100000:1.0:1788305775.584119:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788305775.584128:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015310336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305775.584139:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305775.584151:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51800/0x4a426866e60549fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e60549f7 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305775.584195:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51800/0x4a426866e60549fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e60549f7 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305775.584205:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51800/0x4a426866e60549fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60549f7 expref: 24 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305775.584213:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51800, rc 0) 00000100:00100000:1.0:1788305775.584253:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015310336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305775.584259:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788305775.584454:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305775.584468:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305775.584478:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305775.584531:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310464:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788305775.584562:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305775.584579:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918453b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305775.584607:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310464 00000100:00100000:1.0:1788305775.584611:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310464 00000100:00100000:1.0:1788305775.584636:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788305775.584643:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015310464:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788305775.584656:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788305775.584676:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788305775.584683:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788305775.584755:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015310464:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305775.584762:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788305775.584791:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015310464:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788305775.584835:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788305775.584842:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305775.584850:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889183564c00/0x4a426866e60549f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e60549fe expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305776.150395:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305777.175173:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305778.207212:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305778.645656:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015310592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305778.645747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305778.645833:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310592 00000100:00100000:1.0:1788305778.645842:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310592 00000100:00100000:1.0:1788305778.645907:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788305778.645919:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015310592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788305778.645947:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305778.645994:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb22b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015310592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305778.646001:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788305778.646250:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305778.646329:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015310592:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788305779.222863:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788305779.672802:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305779.672808:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305779.672812:0:38:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305779.672825:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff88918448e800 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305779.672846:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb354700 x1875174015311232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788305779.672894:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788305779.672897:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788305779.672899:0:38:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788305779.672903:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8891894cc000 using connection 192.168.202.155@tcp/0@lo 00000100:00100000:3.0:1788305779.672914:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8891bb355180 x1875174015311744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788305779.672976:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015310720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305779.673064:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673115:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015311360:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673159:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015312000:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673203:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788305779.673208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015310848:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673234:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673257:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015311488:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673308:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673329:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015312128:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673353:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673386:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015310976:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673411:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673427:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015311616:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673451:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673478:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015312256:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673503:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673521:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788305779.673526:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015311104:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673545:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673575:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015311872:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673595:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673604:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015312384:0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.673623:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015311232:0@lo:8:kworker.0 00000100:00100000:3.0:1788305779.673665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673679:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015311744:0@lo:8:kworker.0 00000100:00100000:3.0:1788305779.673697:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.673728:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310720 00000100:00100000:3.0:1788305779.673736:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310720 00000100:00100000:3.0:1788305779.673791:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305779.673802:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015310720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305779.673829:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305779.673872:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015310720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.673880:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305779.673904:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311360 00000100:00100000:3.0:1788305779.673908:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311360 00000100:00100000:3.0:1788305779.673925:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312000 00000100:00100000:3.0:1788305779.673928:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312000 00000100:00100000:3.0:1788305779.673942:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312128 00000100:00100000:3.0:1788305779.673944:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312128 00000100:00100000:3.0:1788305779.673966:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312256 00000100:00100000:3.0:1788305779.673968:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312256 00000100:00100000:3.0:1788305779.673977:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311872 00000100:00100000:3.0:1788305779.673979:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311872 00000100:00100000:3.0:1788305779.673987:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312384 00000100:00100000:3.0:1788305779.673989:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312384 00000100:00100000:3.0:1788305779.674000:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305779.674006:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015311360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674035:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015311360:12345-0@lo:400:kworker.0 Request processed in 30us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674041:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788305779.674052:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305779.674058:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015312000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674082:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875174015312000:12345-0@lo:400:kworker.0 Request processed in 25us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674087:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305779.674097:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305779.674103:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015312128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674126:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015312128:12345-0@lo:400:kworker.0 Request processed in 24us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674132:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305779.674140:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305779.674145:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015312256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674173:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083eda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015312256:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674179:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788305779.674188:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305779.674200:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015311872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674225:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015311872:12345-0@lo:400:kworker.0 Request processed in 26us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674230:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788305779.674240:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305779.674247:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015312384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674309:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015312384:12345-0@lo:400:kworker.0 Request processed in 63us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674316:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788305779.674342:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310848 00000100:00100000:3.0:1788305779.674346:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310848 00000100:00100000:3.0:1788305779.674374:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788305779.674381:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3647:x1875174015310848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674409:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3647:x1875174015310848:12345-0@lo:400:kworker.0 Request processed in 30us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674415:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788305779.674442:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311488 00000100:00100000:3.0:1788305779.674446:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311488 00000100:00100000:3.0:1788305779.674466:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015310976 00000100:00100000:3.0:1788305779.674469:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015310976 00000100:00100000:3.0:1788305779.674480:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305779.674486:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015311488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674517:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015311488:12345-0@lo:400:kworker.0 Request processed in 31us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674523:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788305779.674534:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305779.674540:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015310976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674592:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015310976:12345-0@lo:400:kworker.0 Request processed in 52us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674597:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788305779.674624:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311616 00000100:00100000:3.0:1788305779.674627:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311616 00000100:00100000:3.0:1788305779.674645:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311104 00000100:00100000:3.0:1788305779.674647:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311104 00000100:00100000:3.0:1788305779.674654:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311232 00000100:00100000:3.0:1788305779.674657:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311232 00000100:00100000:3.0:1788305779.674663:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015311744 00000100:00100000:3.0:1788305779.674665:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015311744 00000100:00100000:3.0:1788305779.674672:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305779.674678:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015311616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674706:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015311616:12345-0@lo:400:kworker.0 Request processed in 28us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674711:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788305779.674722:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305779.674727:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015311104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305779.674752:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015311104:12345-0@lo:400:kworker.0 Request processed in 24us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.674757:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788305779.674768:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305779.674772:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015311232:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788305779.674798:0:18928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1788305779.674829:0:18928:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4a426866e6054a05 00002000:00100000:3.0:1788305779.674844:0:18928:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8890821ae000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788305779.674849:0:18928:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788305779.674857:0:18928:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305779.675055:0:18928:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788305779.675081:0:18928:0:(import.c:65:import_set_state_nolock()) ffff8890821a9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305779.675127:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875174015311232:12345-0@lo:8:kworker.0 Request processed in 353us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.675133:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788305779.675146:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788305779.675151:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3646:x1875174015311744:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788305779.675164:0:18928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 609 last 0 00000020:00000080:3.0:1788305779.675180:0:18928:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x4a426866e6054a0c 00002000:00100000:3.0:1788305779.675186:0:18928:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8890821a8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788305779.675190:0:18928:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788305779.675192:0:18928:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788305779.675214:0:18928:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788305779.675226:0:18928:0:(import.c:65:import_set_state_nolock()) ffff8890821ab800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305779.675252:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3646:x1875174015311744:12345-0@lo:8:kworker.0 Request processed in 100us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.675258:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788305779.675323:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305779.675327:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305779.675330:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788305779.675373:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354700 x1875174015311232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305779.675389:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788305779.675397:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788305779.675402:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788305779.675405:0:3646:0:(import.c:65:import_set_state_nolock()) ffff88918448e800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788305779.675425:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788305779.675432:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3646:1875174015311232:0@lo:8:kworker.0 00010000:00080000:3.0:1788305779.675446:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355180 x1875174015311744/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788305804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788305779.675455:0:3646:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788305779.675460:0:3646:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788305779.675464:0:3646:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788305779.675465:0:3646:0:(import.c:65:import_set_state_nolock()) ffff8891894cc000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788305779.675476:0:3646:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788305779.675479:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3646:1875174015311744:0@lo:8:kworker.0 00000004:00080000:3.0:1788305779.675507:0:17895:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788305779.675792:0:17178:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788305779.675810:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17178:1875174015312768:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788305779.675845:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.675868:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2c00 going to sleep for 11 seconds 00000004:00080000:0.0:1788305779.675896:0:17896:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788305779.675909:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313024:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788305779.675932:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.675947:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305779.676008:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312768 00000100:00100000:0.0:1788305779.676013:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312768 00000100:00100000:0.0:1788305779.676051:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313024 00000100:00100000:0.0:1788305779.676054:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313024 00000100:00100000:0.0:1788305779.676073:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788305779.676079:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17178:x1875174015312768:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788305779.676330:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788305779.676339:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1875174015313024:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788305779.676375:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305779.676384:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015312896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305779.676414:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.676442:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305779.676467:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.676484:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788305779.676490:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015312512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305779.676573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.676632:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312896 00000100:00100000:0.0:1788305779.676636:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312896 00000100:00100000:0.0:1788305779.676658:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312640 00000100:00100000:0.0:1788305779.676661:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312640 00000100:00100000:0.0:1788305779.676670:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305779.676675:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875174015312896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305779.676693:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305779.676736:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3650:x1875174015312896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305779.676742:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788305779.676757:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788305779.676762:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015312640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305779.676771:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305779.676796:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875174015312640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305779.676802:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788305779.676815:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788305779.676838:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa9880 x1875174015312896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305779.676854:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015312896:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788305779.676901:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d16a00 x1875174015312640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305779.676913:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015312640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305779.676928:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015312512 00000100:00100000:0.0:1788305779.676931:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015312512 00000100:00100000:0.0:1788305779.676957:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305779.676963:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015312512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788305779.676988:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305779.677030:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015312512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305779.677036:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305779.677064:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015312512:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1788305779.678235:0:17177:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788305779.678482:0:17177:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 609769205460ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788305779.678489:0:17177:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788305779.678753:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015311104:0@lo:400:kworker.0 00010000:00080000:1.0:1788305779.678770:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354a80 x1875174015311872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.678792:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015311872:0@lo:400:kworker.0 00010000:00080000:1.0:1788305779.678811:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184024380 x1875174015312384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.678820:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184024380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015312384:0@lo:400:kworker.0 00000100:00100000:1.0:1788305779.678831:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015310976:0@lo:400:kworker.0 00000100:00100000:1.0:1788305779.678842:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015311616:0@lo:400:kworker.0 00010000:00080000:1.0:1788305779.678852:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184027480 x1875174015312256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.678860:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015312256:0@lo:400:kworker.0 00000100:00100000:1.0:1788305779.678898:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788305779.678907:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015313152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305779.678962:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305779.679144:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313152 00000100:00100000:1.0:1788305779.679151:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313152 00000100:00100000:1.0:1788305779.679192:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305779.679202:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015313152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305779.679247:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305779.679342:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015313152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305779.679349:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788305779.679400:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015313152:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305779.679470:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:739dca1e-bd16-46de-8d05-a6337c8af843:3647:1875174015310848:0@lo:400:kworker.0 00000100:00100000:1.0:1788305779.679492:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015311488:0@lo:400:kworker.0 00010000:00080000:1.0:1788305779.679504:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb357b80 x1875174015312128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.679514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb357b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015312128:0@lo:400:kworker.0 00000100:00100000:1.0:1788305779.679529:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015310720:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788305779.679540:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb354e00 x1875174015311360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.679565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015311360:0@lo:400:kworker.0 00010000:00080000:1.0:1788305779.679593:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8891bb355500 x1875174015312000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305779.679600:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb355500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3647:1875174015312000:0@lo:400:kworker.0 00000004:00080000:0.0:1788305779.684940:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788305779.687639:0:17895:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 609778359642ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788305779.687654:0:17895:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00080000:1.0:1788305779.690644:0:18660:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788305779.690657:0:18660:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788305779.690664:0:18660:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1788305779.692607:0:17884:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788305779.709292:0:18658:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788305779.709303:0:18658:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788305779.709397:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17896:x1875174015313024:12345-0@lo:7:osp-pre-1-1.0 Request processed in 33052us (33458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305779.709408:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788305779.709466:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8a80 x1875174015313024/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788305795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305779.709481:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313024:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788305779.709494:0:17896:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788305779.709536:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313280:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788305779.709580:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.709604:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305779.709621:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313280 00000100:00100000:0.0:1788305779.709626:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313280 00000100:00100000:0.0:1788305779.709658:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788305779.709666:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17896:x1875174015313280:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788305779.709690:0:18661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788305779.712056:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17896:x1875174015313280:12345-0@lo:5:osp-pre-1-1.0 Request processed in 2376us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305779.712072:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788305779.712143:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff88918caa8a80 x1875174015313280/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788305795 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305779.712251:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313280:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788305779.712267:0:17896:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788305779.712322:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313408:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788305779.712368:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305779.712387:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90accc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305779.712403:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313408 00000100:00100000:0.0:1788305779.712408:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313408 00000100:00100000:0.0:1788305779.712442:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788305779.712449:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17896:x1875174015313408:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788305779.712491:0:18928:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788305779.721383:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.721396:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721415:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.721419:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.721425:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721443:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721454:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721475:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721504:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.721572:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.721579:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.721587:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.721592:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.721600:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.721625:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.721633:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009830e43d/0x4a426866e6054a13 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.721652:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.721655:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.721656:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.721963:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.721969:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721979:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.721982:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.721987:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.721997:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722005:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722011:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722028:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305779.722524:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.722530:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722559:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.722564:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.722568:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722577:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722585:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722591:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722609:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788305779.722618:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305779.722622:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722628:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.722631:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722638:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722664:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722672:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722687:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305779.722691:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722697:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.722700:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722707:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722717:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722723:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.722733:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.722734:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.722743:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.724145:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.724154:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.724906:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.727015:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.727022:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.727031:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.727049:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.727060:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.727068:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.727095:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788305779.728185:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.728194:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.728206:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.728209:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.728214:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.728235:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.728244:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.728251:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.728294:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788305779.728722:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305779.728730:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728739:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.728744:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728753:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728770:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728776:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c94dd86/0x4a426866e6054a28 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728809:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.728813:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728819:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.728823:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728830:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728840:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728848:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.728859:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.728861:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.728862:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305779.728968:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.730771:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.730780:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.730796:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.730800:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.730805:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.730818:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.730826:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.730844:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.730862:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.731034:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.731042:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.731050:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.731060:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.731069:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.731084:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.731091:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.731109:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.731111:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.731112:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305779.736141:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305779.736155:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.736174:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1788305779.736178:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305779.736185:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.736200:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.736210:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.736224:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.736405:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305779.738577:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305779.738590:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.738607:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1788305779.738612:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305779.738618:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.738632:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.738642:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.738648:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741848:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305779.741864:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741879:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.741909:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741922:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741948:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741957:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043210328/0x4a426866e6054a3d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741989:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.741992:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.741999:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.742002:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.742010:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.742019:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.742027:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.742034:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.742036:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.744625:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788305779.744640:0:18660:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d857fbc4/0x4a426866e6054a44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.744707:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305779.745715:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305779.745725:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.745740:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1788305779.745745:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305779.745752:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.745766:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.745776:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.745785:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.745803:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788305779.749520:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305779.749533:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.749565:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1788305779.749576:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305779.749583:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.749601:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.749614:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.749622:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.749647:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788305779.749679:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788305779.749687:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749695:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305779.749700:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749708:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749726:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749739:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c7e28cd/0x4a426866e6054a4b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749760:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788305779.749764:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749772:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305779.749775:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749783:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749793:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749800:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007eb8366f/0x4a426866e6054a52 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.749813:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305779.749814:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788305779.749816:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788305779.752251:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788305779.752265:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.752369:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=609s v=(0 0) 00010000:00010000:1.0:1788305779.752374:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305779.752380:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.752394:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.752404:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.752422:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.752450:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305779.753927:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305779.753936:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.753949:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.753954:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.753965:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.753986:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.753994:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096d56d0e/0x4a426866e6054a59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754015:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.754017:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.754019:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.754452:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.754468:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754480:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.754484:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.754492:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754505:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754514:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754523:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754544:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305779.754565:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305779.754570:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754577:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.754582:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754591:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754609:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754616:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c022821/0x4a426866e6054a60 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.754629:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.754631:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.754633:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.756691:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.756701:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.756718:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.756722:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.756728:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.756741:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.756750:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.756759:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.756789:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.757429:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.757439:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.757448:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.757454:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.757463:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.757482:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.757490:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fab0aba/0x4a426866e6054a67 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.757513:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.757514:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.757516:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.757740:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.757746:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.757757:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.757760:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.757764:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.757774:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.757776:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.757782:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.757790:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.757811:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305779.758029:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.758035:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.758044:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.758047:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.758055:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.758069:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.758075:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae17ee94/0x4a426866e6054a6e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.758092:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.758093:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.758095:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788305779.758172:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788305779.758178:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.758186:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=609s v=(0 0) 00010000:00010000:0.0:1788305779.758195:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788305779.758201:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.758211:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.758219:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.758226:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.758245:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305779.758851:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.758858:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.758882:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.758885:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.758890:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.758900:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.758907:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.758915:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.758936:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788305779.759179:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788305779.759185:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759193:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.759197:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759205:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759219:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759238:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000226d3624/0x4a426866e6054a75 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759252:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305779.759255:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759261:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.759264:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759272:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759401:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759408:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071cf56b0/0x4a426866e6054a7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.759420:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.759421:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.759423:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.760504:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.760514:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.760526:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.760529:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.760535:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.760557:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.760579:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.760587:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.760604:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788305779.761402:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788305779.761410:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.761428:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:0.0:1788305779.761432:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.761442:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.761458:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.761465:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d63c9cf2/0x4a426866e6054a83 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305779.761483:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.761485:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.761486:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.761613:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.761620:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.761629:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.761632:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.761638:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.761648:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.761656:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.761662:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.761692:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305779.761713:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.761719:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.761726:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.761736:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.761743:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.761754:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.761761:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006486b561/0x4a426866e6054a8a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.761776:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.761778:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.761779:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.761989:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.762428:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.762435:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.762445:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.762448:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.762453:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.762463:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.762470:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.762478:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.762493:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788305779.764672:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.764685:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.764700:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.764715:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.764721:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.764734:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.764745:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.764752:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.764773:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788305779.765717:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788305779.765728:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765739:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565000 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.765744:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765754:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765773:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765789:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000330960fe/0x4a426866e6054a91 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765812:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.765815:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765822:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.765825:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765832:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765842:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765849:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004812786c/0x4a426866e6054a98 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.765860:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.765861:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.765863:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.768957:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.768973:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.768994:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.769000:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.769008:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.769025:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.769037:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.769053:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.769072:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:1.0:1788305779.769137:0:19473:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788305779.769169:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788305779.769174:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788305779.769370:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17896:x1875174015313408:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56916us (56996us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788305779.769392:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305779.769446:0:17896:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788305779.769453:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17896:1875174015313408:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788305779.769471:0:17896:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00010000:00010000:2.0:1788305779.769486:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.769496:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.769513:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.769519:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305779.769522:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083edb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1875174015313536:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788305779.769536:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.769564:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.769573:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2995238/0x4a426866e6054a9f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305779.769583:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788305779.769602:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.769605:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.769607:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305779.769609:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891b90accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305779.769639:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313536 00000100:00100000:3.0:1788305779.769644:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313536 00000100:00100000:3.0:1788305779.769692:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788305779.769701:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1875174015313536:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788305779.769755:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17896:x1875174015313536:12345-0@lo:900:osp-pre-1-1.0 Request processed in 55us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.769761:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00002000:00010000:3.0:1788305779.770481:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.770490:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.770515:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.770519:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.770525:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.770537:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.770557:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.770566:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.770584:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305779.770629:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.770635:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.770643:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183564e00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.770647:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.770656:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.770673:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.770680:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012bbaf2c/0x4a426866e6054aa6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.770695:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.770697:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.770699:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788305779.770728:0:17896:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083edb100 x1875174015313536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788305795 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305779.770739:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083edb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17896:1875174015313536:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788305779.772346:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.772358:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.772383:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.772388:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.772394:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.772407:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.772432:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.772440:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.772459:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788305779.773430:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788305779.773450:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.773461:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20400 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:2.0:1788305779.773466:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.773475:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.773492:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.773512:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058b6381b/0x4a426866e6054aad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305779.773532:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.773534:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305779.773535:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.775559:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.775574:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.775590:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.775594:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.775601:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.775613:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.775623:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.775630:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.775670:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.775841:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.775850:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.775859:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.775863:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.775872:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.775888:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.775896:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec061e7/0x4a426866e6054ab4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.775916:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.775919:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.775920:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.776041:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.776047:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776057:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.776061:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.776065:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776073:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776080:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776087:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776111:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.776150:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.776154:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.776161:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.776179:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.776188:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.776200:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.776207:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce402cd2/0x4a426866e6054abb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.776622:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.776625:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.776626:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.776701:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.776708:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776717:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.776726:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.776731:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776741:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776748:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776756:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.776778:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.777037:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.777043:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777051:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20200 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.777054:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777062:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777075:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777089:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cddc9fbd/0x4a426866e6054ac2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777104:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.777106:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.777107:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.777168:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.777173:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777181:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.777185:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.777189:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777199:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777206:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777220:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777236:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788305779.777383:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.777388:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777395:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.777399:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777406:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777416:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777423:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918f8a09/0x4a426866e6054ac9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.777436:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.777438:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.777440:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788305779.777671:0:18660:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788305779.777677:0:18660:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777685:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=609s v=(0 0) 00010000:00010000:3.0:1788305779.777688:0:18660:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305779.777692:0:18660:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777701:0:18660:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777708:0:18660:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.777715:0:18660:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305779.778205:0:18660:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788305779.778252:0:18660:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788305779.778389:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17178:x1875174015312768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102305us (102538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305779.778407:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788305779.778471:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17178:1875174015312768:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788305779.778488:0:17178:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788305779.778538:0:17178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17178:1875174015313664:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788305779.778587:0:17178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305779.778610:0:17178:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918670b540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305779.778629:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313664 00000100:00100000:3.0:1788305779.778635:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313664 00000100:00100000:3.0:1788305779.778677:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305779.778684:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17178:x1875174015313664:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788305779.778718:0:18661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:3.0:1788305779.785634:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17178:x1875174015313664:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6943us (7040us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788305779.785647:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305779.785714:0:17178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17178:1875174015313664:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788305779.785728:0:17178:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788305779.787326:0:17141:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305779.787339:0:17141:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.787354:0:17141:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20a00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305779.787359:0:17141:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.787370:0:17141:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.787391:0:17141:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.787398:0:17141:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000876502d7/0x4a426866e6054ad0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18660 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305779.787419:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.787422:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305779.787423:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305779.787524:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305780.245505:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788305780.511413:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788305781.273963:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305781.782003:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788305782.294260:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788305782.311935:0:19830:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg255-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788305783.321479:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305783.408996:0:19882:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305783.409245:0:19882:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788305783.765539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015313792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305783.765620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305783.765696:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313792 00000100:00100000:2.0:1788305783.765703:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313792 00000100:00100000:2.0:1788305783.765765:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788305783.765776:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015313792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305783.765807:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305783.765851:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015313792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305783.765858:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788305783.765878:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305783.765910:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015313792:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788305784.344641:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788305784.595845:0:19933:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788305784.596102:0:19933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788305784.790256:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305784.790366:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790431:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015314432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790460:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790464:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015314048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790477:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015314944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790495:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790497:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790534:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015314560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790539:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015315456:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790560:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790576:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788305784.790582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015314304:0@lo:400:kworker.0 00000100:00100000:1.0:1788305784.790582:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015315072:0@lo:400:kworker.0 00000100:00100000:1.0:1788305784.790602:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790603:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790617:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015314816:0@lo:400:kworker.0 00000100:00100000:1.0:1788305784.790620:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788305784.790624:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015314176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790635:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790640:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790648:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015315328:0@lo:400:kworker.0 00000100:00100000:1.0:1788305784.790653:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015314688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790669:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305784.790681:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015315200:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790695:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015313920 00000100:00100000:1.0:1788305784.790699:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.790702:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015313920 00000100:00100000:1.0:1788305784.790721:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314048 00000100:00100000:1.0:1788305784.790724:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314048 00000100:00100000:3.0:1788305784.790757:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305784.790757:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305784.790767:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015313920:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305784.790767:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015314048:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788305784.790790:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305784.790814:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015314048:12345-0@lo:400:kworker.0 Request processed in 49us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.790818:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015313920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305784.790822:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788305784.790823:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788305784.790844:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314432 00000100:00100000:3.0:1788305784.790847:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314432 00000100:00100000:1.0:1788305784.790850:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314560 00000100:00100000:1.0:1788305784.790852:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314560 00000100:00100000:3.0:1788305784.790865:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314944 00000100:00100000:3.0:1788305784.790867:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314944 00000100:00100000:1.0:1788305784.790871:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314176 00000100:00100000:1.0:1788305784.790872:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314176 00000100:00100000:3.0:1788305784.790879:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315456 00000100:00100000:3.0:1788305784.790881:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315456 00000100:00100000:1.0:1788305784.790884:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305784.790889:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015314560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790891:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315072 00000100:00100000:3.0:1788305784.790893:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315072 00000100:00100000:3.0:1788305784.790904:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315328 00000100:00100000:3.0:1788305784.790907:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315328 00000100:00100000:3.0:1788305784.790918:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315200 00000100:00100000:3.0:1788305784.790920:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315200 00000100:00100000:1.0:1788305784.790921:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015314560:12345-0@lo:400:kworker.0 Request processed in 32us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305784.790927:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788305784.790936:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305784.790942:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305784.790942:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015314176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790947:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015314432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.790975:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015314432:12345-0@lo:400:kworker.0 Request processed in 27us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305784.790975:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015314176:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.790981:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788305784.790981:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788305784.790991:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788305784.790997:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015314944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791020:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015314944:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305784.791020:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015314176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791025:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788305784.791028:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015314048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791036:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788305784.791036:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015314560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791042:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015315456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791083:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015315456:12345-0@lo:400:kworker.0 Request processed in 41us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791090:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788305784.791104:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305784.791110:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015315072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791144:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015315072:12345-0@lo:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791149:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788305784.791163:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305784.791168:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015315328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791193:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015315328:12345-0@lo:400:kworker.0 Request processed in 25us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791198:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788305784.791218:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305784.791223:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015315200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791249:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1875174015315200:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791254:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788305784.791305:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314304 00000100:00100000:3.0:1788305784.791309:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314304 00000100:00100000:3.0:1788305784.791335:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314816 00000100:00100000:3.0:1788305784.791338:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314816 00000100:00100000:3.0:1788305784.791349:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015314688 00000100:00100000:3.0:1788305784.791351:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015314688 00000100:00100000:3.0:1788305784.791363:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305784.791368:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015314304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791398:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015314304:12345-0@lo:400:kworker.0 Request processed in 30us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791404:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788305784.791415:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305784.791420:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015314816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791445:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015314816:12345-0@lo:400:kworker.0 Request processed in 25us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791451:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788305784.791461:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788305784.791467:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015314688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791491:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015314688:12345-0@lo:400:kworker.0 Request processed in 24us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.791496:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788305784.791533:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305784.791544:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305784.791546:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305784.791548:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305784.791581:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015314304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791591:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015314816:0@lo:400:kworker.0 00010000:00080000:3.0:1788305784.791604:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d18e00 x1875174015315328/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305784.791614:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015315328:0@lo:400:kworker.0 00010000:00080000:3.0:1788305784.791623:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d1b100 x1875174015315456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305784.791631:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015315456:0@lo:400:kworker.0 00010000:00080000:3.0:1788305784.791640:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d18000 x1875174015314432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305784.791647:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015314432:0@lo:400:kworker.0 00010000:00080000:3.0:1788305784.791656:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d1aa00 x1875174015314944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305784.791664:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015314944:0@lo:400:kworker.0 00000100:00100000:3.0:1788305784.791677:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015313920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305784.792859:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015314688:0@lo:400:kworker.0 00010000:00080000:1.0:1788305784.792875:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d18a80 x1875174015315200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305784.792884:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3649:1875174015315200:0@lo:400:kworker.0 00010000:00080000:1.0:1788305784.792894:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d19180 x1875174015315072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305784.792902:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015315072:0@lo:400:kworker.0 00000100:00100000:1.0:1788305784.793083:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015315584:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788305784.793134:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305784.798675:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315584 00000100:00100000:2.0:1788305784.798692:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315584 00000100:00100000:3.0:1788305784.798850:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788305784.798860:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015315584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788305784.798901:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305784.799013:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015315584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (5877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.799034:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788305784.799663:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015315584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305784.801895:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015315712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305784.801966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305784.802017:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315712 00000100:00100000:3.0:1788305784.802023:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315712 00000100:00100000:3.0:1788305784.802064:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305784.802073:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015315712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305784.802106:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788305784.802158:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015315712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.802166:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788305784.802220:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015315712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305784.802240:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305784.802247:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305784.802914:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305784.803127:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015315968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305784.803160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305784.837453:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315840 00000100:00100000:0.0:1788305784.837469:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315840 00000100:00100000:0.0:1788305784.837542:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015315968 00000100:00100000:0.0:1788305784.837546:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015315968 00000100:00100000:0.0:1788305784.837566:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305784.837591:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015315840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305784.837626:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305784.837729:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3648:x1875174015315840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (34816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305784.837737:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788305784.837753:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788305784.837759:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015315968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788305784.837769:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305784.837794:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb229f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015315968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (34633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305784.837800:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305784.838097:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb354a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015315968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305784.838114:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb356300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015315840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788305784.988476:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305784.988826:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254080 00000100:00100000:3.0:1788305784.988838:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254080 00000100:00100000:3.0:1788305784.988889:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:3.0:1788305784.988898:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2394:x1875173994254080:12345-192.168.202.55@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788305784.988927:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f38dbe3c-89d2-4155-8e7f-a4033c74b7ae@192.168.202.55@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:3.0:1788305784.988956:0:17145:0:(genops.c:1385:class_connect()) connect: client f38dbe3c-89d2-4155-8e7f-a4033c74b7ae, cookie 0x4a426866e6054ad7 00000100:00080000:3.0:1788305784.989094:0:17145:0:(import.c:65:import_set_state_nolock()) ffff8890821ac000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788305784.989186:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+5:2394:x1875173994254080:12345-192.168.202.55@tcp:250:mount.lustre.0 Request processed in 288us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305784.989195:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 118 00000100:00100000:1.0:1788305785.002659:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.002754:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254208 00000100:00100000:3.0:1788305785.002764:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254208 00000100:00100000:3.0:1788305785.002824:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:3.0:1788305785.002834:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+5:14902:x1875173994254208:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305785.002849:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305785.002867:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f20c00/0x4a426866e6054ade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08789 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.002897:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20c00/0x4a426866e6054ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08789 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.002909:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f20c00/0x4a426866e6054ade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08789 expref: 6 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.002918:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20c00, rc 0) 00000100:00100000:3.0:1788305785.003040:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+6:14902:x1875173994254208:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 207us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.003047:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 119 00000100:00100000:2.0:1788305785.008086:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.010907:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254336 00000100:00100000:1.0:1788305785.010921:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254336 00000100:00100000:1.0:1788305785.010992:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:1.0:1788305785.011019:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+6:14902:x1875173994254336:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788305785.011647:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+6:14902:x1875173994254336:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 628us (3568us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788305785.011657:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 120 00000100:00100000:2.0:1788305785.027105:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.031778:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254464 00000100:00100000:1.0:1788305785.031794:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254464 00000100:00100000:0.0:1788305785.039916:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:0.0:1788305785.039932:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+6:14902:x1875173994254464:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305785.039951:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305785.039972:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f9c00/0x4a426866e6054ae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08790 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305785.040004:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f9c00/0x4a426866e6054ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08790 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305785.040017:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f9c00/0x4a426866e6054ae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08790 expref: 7 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305785.040026:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9c00, rc 0) 00000100:00100000:0.0:1788305785.040100:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+7:14902:x1875173994254464:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 172us (13004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.040126:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 121 00000100:00100000:2.0:1788305785.043856:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.044056:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254592 00000100:00100000:0.0:1788305785.044067:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254592 00000100:00100000:0.0:1788305785.044178:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:0.0:1788305785.044192:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+7:14902:x1875173994254592:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305785.044422:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14902:x1875173994254592:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 233us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.044430:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 122 00000100:00100000:2.0:1788305785.051080:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.051163:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254720 00000100:00100000:0.0:1788305785.051184:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254720 00000100:00100000:0.0:1788305785.051241:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:0.0:1788305785.051252:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14902:x1875173994254720:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788305785.052523:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14902:x1875173994254720:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 1265us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.052537:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 123 00000100:00100000:2.0:1788305785.063590:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.063774:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254848 00000100:00100000:0.0:1788305785.063785:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254848 00000100:00100000:0.0:1788305785.063842:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:0.0:1788305785.063853:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994254848:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305785.064018:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994254848:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 166us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.064026:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 124 00000100:00100000:2.0:1788305785.112591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.112703:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994254976 00000100:00100000:0.0:1788305785.112714:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994254976 00000100:00100000:0.0:1788305785.112790:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:0.0:1788305785.112800:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994254976:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305785.112952:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994254976:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 152us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.112961:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 125 00000100:00100000:2.0:1788305785.123175:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.123308:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255104 00000100:00100000:3.0:1788305785.123317:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255104 00000100:00100000:3.0:1788305785.123364:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:3.0:1788305785.123374:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994255104:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305785.123533:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14921:x1875173994255104:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.123541:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 126 00000100:00100000:2.0:1788305785.161941:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.162063:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255232 00000100:00100000:1.0:1788305785.162074:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255232 00000100:00100000:1.0:1788305785.162134:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:1.0:1788305785.162145:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890820acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+8:14902:x1875173994255232:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788305785.162160:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305785.162179:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c51a00/0x4a426866e6054aec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe087c1 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.162211:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c51a00/0x4a426866e6054aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c1 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.162222:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c51a00/0x4a426866e6054aec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c1 expref: 9 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.162231:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51a00, rc 0) 00000100:00100000:1.0:1788305785.162346:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890820acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+9:14902:x1875173994255232:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 202us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305785.162354:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 127 00000100:00100000:2.0:1788305785.175062:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.175183:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255360 00000100:00100000:0.0:1788305785.175193:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255360 00000100:00100000:0.0:1788305785.175256:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:0.0:1788305785.175303:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+9:14902:x1875173994255360:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788305785.175331:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788305785.175356:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788305785.175360:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788305785.175364:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788305785.175367:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788305785.175369:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788305785.181772:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+9:14902:x1875173994255360:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 6496us (6708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.181789:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 128 00000100:00100000:2.0:1788305785.186896:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.186987:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255488 00000100:00100000:3.0:1788305785.186997:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255488 00000100:00100000:3.0:1788305785.187068:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:3.0:1788305785.187079:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+9:14902:x1875173994255488:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305785.187095:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305785.187112:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe087c8 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.187140:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.187152:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305785.187161:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21800, rc 0) 00000100:00100000:3.0:1788305785.187217:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14902:x1875173994255488:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 140us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.187225:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 129 00000100:00100000:2.0:1788305785.200518:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.200776:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255616 00000100:00100000:3.0:1788305785.200789:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255616 00000100:00100000:3.0:1788305785.200887:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:3.0:1788305785.200898:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14902:x1875173994255616:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305785.201071:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14902:x1875173994255616:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 174us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.201079:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 130 00000100:00100000:2.0:1788305785.203608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.203708:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255744 00000100:00100000:1.0:1788305785.203719:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255744 00000100:00100000:1.0:1788305785.203813:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:1.0:1788305785.203824:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14902:x1875173994255744:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788305785.203980:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14902:x1875173994255744:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 157us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305785.203989:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 131 00000100:00100000:2.0:1788305785.213446:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.213552:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994255872 00000100:00100000:3.0:1788305785.213562:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994255872 00000100:00100000:3.0:1788305785.213678:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:3.0:1788305785.213690:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14927:x1875173994255872:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305785.213940:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14927:x1875173994255872:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 251us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.213949:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 132 00000100:00100000:2.0:1788305785.224138:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.224854:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256000 00000100:00100000:1.0:1788305785.224867:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256000 00000100:00100000:1.0:1788305785.224933:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:1.0:1788305785.224943:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14927:x1875173994256000:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305785.225129:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb362450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:14927:x1875173994256000:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 186us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305785.225136:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 133 00000100:00100000:2.0:1788305785.233117:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305785.233534:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305785.233634:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256128 00000100:00100000:0.0:1788305785.233645:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256128 00000100:00100000:0.0:1788305785.233697:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256384 00000100:00100000:0.0:1788305785.233701:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256384 00000100:00100000:0.0:1788305785.233723:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305785.233744:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875173994256128:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788305785.233774:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:0.0:1788305785.233835:0:17153:0:(genops.c:1385:class_connect()) connect: client 0f32c93b-849d-4ca6-ae0d-05edb696d5c1, cookie 0x4a426866e6054afa 00000004:00100000:0.0:1788305785.233862:0:17153:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788305785.234103:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8891b998c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305785.234202:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2394:x1875173994256128:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 458us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.234211:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305785.234232:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:0.0:1788305785.234237:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2394:x1875173994256384:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788305785.234255:0:17153:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:0.0:1788305785.234322:0:17153:0:(genops.c:1385:class_connect()) connect: client 0f32c93b-849d-4ca6-ae0d-05edb696d5c1, cookie 0x4a426866e6054b01 00000004:00100000:0.0:1788305785.234336:0:17153:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788305785.234485:0:17153:0:(import.c:65:import_set_state_nolock()) ffff8891b998e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305785.234526:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2394:x1875173994256384:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 287us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305785.234534:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788305785.255442:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.255485:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.255546:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.255577:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256512 00000100:00100000:3.0:1788305785.255585:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256512 00000100:00100000:3.0:1788305785.255641:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256256 00000100:00100000:3.0:1788305785.255644:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256256 00000100:00100000:3.0:1788305785.255658:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256640 00000100:00100000:3.0:1788305785.255659:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256640 00000100:00100000:3.0:1788305785.255674:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305785.255683:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:0:x1875173994256512:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305785.255722:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788305785.255808:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:0:x1875173994256512:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 125us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.255815:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305785.255833:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305785.255839:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:0:x1875173994256256:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305785.255855:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788305785.255893:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:0:x1875173994256256:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 54us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.255899:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305785.255913:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305785.255920:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994256640:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788305785.255946:0:17152:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788305785.255970:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994256640:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 51us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.255977:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00080000:3.0:1788305785.255994:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305785.255998:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305785.270955:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.271038:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256768 00000100:00100000:3.0:1788305785.271047:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256768 00000100:00100000:3.0:1788305785.271109:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788305785.271118:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994256768:12345-192.168.202.55@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788305785.271399:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994256768:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 281us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.271408:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:2.0:1788305785.288787:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305785.288902:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.288946:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257152 00000100:00100000:2.0:1788305785.288962:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305785.288966:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257152 00000100:00100000:3.0:1788305785.289078:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788305785.289092:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994257152:12345-192.168.202.55@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788305785.289243:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994257152:12345-192.168.202.55@tcp:900:mount.lustre.0 Request processed in 153us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305785.289252:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:0.0:1788305785.290682:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994256896 00000100:00100000:0.0:1788305785.290698:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994256896 00000100:00100000:0.0:1788305785.290753:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257024 00000100:00100000:0.0:1788305785.290757:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257024 00000100:00100000:0.0:1788305785.290787:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305785.290804:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2394:x1875173994256896:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788305785.290882:0:18928:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:0.0:1788305785.290915:0:18928:0:(genops.c:1385:class_connect()) connect: client 0f32c93b-849d-4ca6-ae0d-05edb696d5c1, cookie 0x4a426866e6054b08 00002000:00100000:0.0:1788305785.290927:0:18928:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0f32c93b-849d-4ca6-ae0d-05edb696d5c1/ffff8891b998a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788305785.290957:0:18928:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788305785.291162:0:18928:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788305785.291953:0:18928:0:(import.c:65:import_set_state_nolock()) ffff8891b998d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788305785.292023:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2394:x1875173994256896:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 1224us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305785.293533:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788305785.293548:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2394:x1875173994257024:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788305785.293588:0:18661:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp t0 exp 0000000000000000 cur 615 last 0 00000020:00000080:2.0:1788305785.293623:0:18661:0:(genops.c:1385:class_connect()) connect: client 0f32c93b-849d-4ca6-ae0d-05edb696d5c1, cookie 0x4a426866e6054b0f 00002000:00100000:2.0:1788305785.293637:0:18661:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0f32c93b-849d-4ca6-ae0d-05edb696d5c1/ffff88908253a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788305785.293670:0:18661:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788305785.293911:0:18661:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788305785.293943:0:18661:0:(import.c:65:import_set_state_nolock()) ffff889082538000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305785.293995:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2394:x1875173994257024:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 449us (5034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305785.294004:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305785.298387:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:2.0:1788305785.303956:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000001:00100000:3.0:1788305785.305596:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000001:00080000:3.0:1788305785.305612:0:19473:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1788305785.306765:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257280 00000100:00100000:0.0:1788305785.306782:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257280 00000100:00100000:0.0:1788305785.306852:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788305785.306863:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994257280:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788305785.311674:0:17154:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4722us 00000004:00200000:2.0:1788305785.320941:0:17154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788305785.321104:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14902:x1875173994257280:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 14236us (17151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305785.321120:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00010000:00010000:2.0:1788305785.365602:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305785.591528:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305785.591772:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257408 00000100:00100000:1.0:1788305785.591783:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257408 00000100:00100000:1.0:1788305785.591845:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:1.0:1788305785.591857:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:14950:x1875173994257408:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:1.0:1788305785.591879:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305785.591904:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054b16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe087f9 expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.591974:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.591987:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.592001:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305785.592074:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305785.592078:0:18524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305785.592112:0:18524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.592139:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054b16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087f9 expref: 8 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.592158:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087f9 expref: 7 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305785.592166:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:1.0:1788305785.592169:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305785.592172:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50200, rc 0) 00000100:00100000:1.0:1788305785.592235:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:14950:x1875173994257408:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 381us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305785.592243:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00010000:00010000:0.0:1788305786.391662:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305787.414076:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305788.201765:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.203578:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257536 00000100:00100000:0.0:1788305788.203595:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257536 00000100:00100000:0.0:1788305788.203747:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00080000:3.0:1788305788.203751:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305788.203764:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15003:x1875173994257536:12345-192.168.202.55@tcp:41:lfs.0 00000004:00000024:0.0:1788305788.203808:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305788.203907:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15003:x1875173994257536:12345-192.168.202.55@tcp:41:lfs.0 Request processed in 148us (2155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.203914:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788305788.211327:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.211447:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257664 00000100:00100000:1.0:1788305788.211461:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257664 00000100:00100000:1.0:1788305788.211557:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:1.0:1788305788.211582:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:15003:x1875173994257664:12345-192.168.202.55@tcp:41:lfs.0 00000004:00000024:1.0:1788305788.211623:0:18524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305788.211723:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:15003:x1875173994257664:12345-192.168.202.55@tcp:41:lfs.0 Request processed in 155us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.211730:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:3.0:1788305788.212202:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305788.222519:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.223179:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257792 00000100:00100000:0.0:1788305788.223192:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257792 00000100:00100000:0.0:1788305788.223366:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:0.0:1788305788.223377:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:15003:x1875173994257792:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:0.0:1788305788.223420:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00080000:3.0:1788305788.223599:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305788.224125:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:15003:x1875173994257792:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 748us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.224134:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:2.0:1788305788.233867:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.234045:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994257920 00000100:00100000:0.0:1788305788.234076:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994257920 00000100:00100000:0.0:1788305788.234151:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788305788.234162:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15003:x1875173994257920:12345-192.168.202.55@tcp:13:lfs.0 00002000:00000024:0.0:1788305788.234254:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305788.234390:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15003:x1875173994257920:12345-192.168.202.55@tcp:13:lfs.0 Request processed in 229us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.234398:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:3.0:1788305788.235130:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788305788.437503:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305788.505509:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.505816:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258048 00000100:00100000:3.0:1788305788.505835:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258048 00000100:00100000:3.0:1788305788.505941:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:3.0:1788305788.505953:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+10:15037:x1875173994258048:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788305788.505970:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305788.505989:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f20a00/0x4a426866e6054b24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08800 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305788.506023:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20a00/0x4a426866e6054b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08800 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305788.506034:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f20a00/0x4a426866e6054b24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08800 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305788.506046:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20a00, rc 0) 00000100:00100000:3.0:1788305788.506140:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258048:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 189us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.506234:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 134 00000100:00100000:1.0:1788305788.519906:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.524174:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258176 00000100:00100000:0.0:1788305788.524190:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258176 00000100:00100000:0.0:1788305788.525187:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:0.0:1788305788.525201:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258176:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788305788.527451:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb361050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258176:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 2241us (7881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.527478:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 135 00000100:00100000:2.0:1788305788.542174:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.542944:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258304 00000100:00100000:1.0:1788305788.542957:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258304 00000100:00100000:1.0:1788305788.543030:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:1.0:1788305788.543040:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258304:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788305788.543439:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258304:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 398us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.543448:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 136 00000100:00100000:1.0:1788305788.571495:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.574981:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258432 00000100:00100000:0.0:1788305788.574997:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258432 00000100:00100000:0.0:1788305788.575079:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:0.0:1788305788.575091:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258432:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305788.580001:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258432:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 4900us (8502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.580028:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 137 00000100:00100000:2.0:1788305788.626835:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.626948:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258560 00000100:00100000:3.0:1788305788.626997:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258560 00000100:00100000:3.0:1788305788.627070:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:3.0:1788305788.627081:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258560:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788305788.627339:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258560:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 259us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.627349:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 138 00000100:00100000:2.0:1788305788.637660:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.637857:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258688 00000100:00100000:0.0:1788305788.637867:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258688 00000100:00100000:0.0:1788305788.637924:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:0.0:1788305788.637934:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258688:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305788.638123:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15042:x1875173994258688:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 189us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.638132:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 139 00000100:00100000:2.0:1788305788.657019:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.673256:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258816 00000100:00100000:1.0:1788305788.673272:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258816 00000100:00100000:1.0:1788305788.673381:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:1.0:1788305788.673392:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:15037:x1875173994258816:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788305788.673410:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305788.673428:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50c00/0x4a426866e6054b2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08831 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305788.673460:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50c00/0x4a426866e6054b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08831 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305788.673485:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50c00/0x4a426866e6054b2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08831 expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305788.673494:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50c00, rc 0) 00000100:00100000:1.0:1788305788.673578:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:15037:x1875173994258816:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 188us (16579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.673586:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 140 00000100:00100000:2.0:1788305788.684004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.685683:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994258944 00000100:00100000:3.0:1788305788.685697:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994258944 00000100:00100000:3.0:1788305788.685768:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:3.0:1788305788.685779:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:15037:x1875173994258944:12345-192.168.202.55@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788305788.685808:0:17145:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788305788.685833:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788305788.685837:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788305788.685841:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788305788.685844:0:17145:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788305788.685847:0:17145:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788305788.688432:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:15037:x1875173994258944:12345-192.168.202.55@tcp:256:mount.lustre.0 Request processed in 2645us (4428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.688446:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 141 00000100:00100000:2.0:1788305788.696850:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.697180:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259072 00000100:00100000:0.0:1788305788.697191:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259072 00000100:00100000:0.0:1788305788.697250:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:0.0:1788305788.697262:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:15037:x1875173994259072:12345-192.168.202.55@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788305788.697300:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305788.697318:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08838 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305788.697350:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305788.697363:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 13 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305788.697373:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9e00, rc 0) 00000100:00100000:0.0:1788305788.697437:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e075050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15037:x1875173994259072:12345-192.168.202.55@tcp:101:mount.lustre.0 Request processed in 177us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.697444:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 142 00000100:00100000:2.0:1788305788.709916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.710103:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259200 00000100:00100000:3.0:1788305788.710114:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259200 00000100:00100000:3.0:1788305788.710170:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:3.0:1788305788.710182:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15037:x1875173994259200:12345-192.168.202.55@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788305788.710382:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e076050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15037:x1875173994259200:12345-192.168.202.55@tcp:501:mount.lustre.0 Request processed in 201us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.710390:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 143 00000100:00100000:2.0:1788305788.715655:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.715811:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259328 00000100:00100000:1.0:1788305788.715822:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259328 00000100:00100000:1.0:1788305788.715888:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:1.0:1788305788.715901:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15037:x1875173994259328:12345-192.168.202.55@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788305788.716078:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15037:x1875173994259328:12345-192.168.202.55@tcp:503:mount.lustre.0 Request processed in 180us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.716087:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 144 00000100:00100000:2.0:1788305788.743875:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.744555:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259456 00000100:00100000:1.0:1788305788.744582:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259456 00000100:00100000:1.0:1788305788.744653:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:1.0:1788305788.744665:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15047:x1875173994259456:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788305788.744869:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15047:x1875173994259456:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 206us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.744878:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 145 00000100:00100000:3.0:1788305788.760209:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.760483:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259584 00000100:00100000:0.0:1788305788.760492:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259584 00000100:00100000:0.0:1788305788.762688:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:0.0:1788305788.762720:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15047:x1875173994259584:12345-192.168.202.55@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788305788.762924:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919e077050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:15047:x1875173994259584:12345-192.168.202.55@tcp:502:llog_process_th.0 Request processed in 220us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.762942:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 146 00000100:00100000:3.0:1788305788.780560:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.780605:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.780634:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.780684:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.780711:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260736 00000100:00100000:3.0:1788305788.780721:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260736 00000100:00100000:2.0:1788305788.780741:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259712 00000100:00100000:2.0:1788305788.780746:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259712 00000100:00100000:2.0:1788305788.780785:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259968 00000100:00100000:2.0:1788305788.780788:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259968 00000100:00100000:3.0:1788305788.780790:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788305788.780795:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260480 00000100:00100000:2.0:1788305788.780797:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260480 00000100:00100000:3.0:1788305788.780799:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2397:x1875173994260736:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305788.780815:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788305788.780822:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2397:x1875173994260480:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305788.780892:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2397:x1875173994260480:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305788.780900:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:2.0:1788305788.780919:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305788.780923:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994259712:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788305788.780951:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 41b2c320-efb9-4bcd-bd61-e9037c280b63@192.168.202.55@tcp t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:2.0:1788305788.780986:0:17152:0:(genops.c:1385:class_connect()) connect: client 41b2c320-efb9-4bcd-bd61-e9037c280b63, cookie 0x4a426866e6054b39 00000004:00100000:2.0:1788305788.781012:0:17152:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788305788.781128:0:17152:0:(import.c:65:import_set_state_nolock()) ffff889082538800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305788.781160:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2394:x1875173994259712:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 235us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305788.781180:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:2.0:1788305788.781196:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:2.0:1788305788.781200:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2394:x1875173994259968:12345-192.168.202.55@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788305788.781214:0:17152:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 41b2c320-efb9-4bcd-bd61-e9037c280b63@192.168.202.55@tcp t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:2.0:1788305788.781234:0:17152:0:(genops.c:1385:class_connect()) connect: client 41b2c320-efb9-4bcd-bd61-e9037c280b63, cookie 0x4a426866e6054b40 00000004:00100000:2.0:1788305788.781248:0:17152:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788305788.781344:0:17152:0:(import.c:65:import_set_state_nolock()) ffff88908253c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788305788.781369:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2394:x1875173994259968:12345-192.168.202.55@tcp:38:mount.lustre.0 Request processed in 167us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305788.781382:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:3.0:1788305788.781399:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2397:x1875173994260736:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 600us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.781405:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788305788.781438:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.781506:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260352 00000100:00100000:1.0:1788305788.781511:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260352 00000100:00100000:1.0:1788305788.781543:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:1.0:1788305788.781550:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2397:x1875173994260352:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305788.781578:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2397:x1875173994260352:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 29us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.781584:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:2.0:1788305788.791272:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.791496:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260608 00000100:00100000:1.0:1788305788.791509:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260608 00000100:00100000:1.0:1788305788.791621:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:1.0:1788305788.791633:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2397:x1875173994260608:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305788.791733:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2397:x1875173994260608:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 102us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.791741:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:1.0:1788305788.814781:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.815859:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260096 00000100:00100000:0.0:1788305788.815872:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260096 00000100:00080000:3.0:1788305788.816058:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305788.816582:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788305788.816596:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:0:x1875173994260096:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788305788.816629:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305788.816739:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:0:x1875173994260096:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 147us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.816747:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:3.0:1788305788.817898:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.830492:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.832931:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260224 00000100:00100000:1.0:1788305788.832947:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260224 00000100:00100000:0.0:1788305788.833211:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:0.0:1788305788.833227:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994260224:12345-192.168.202.55@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788305788.833261:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305788.833360:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994260224:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 137us (15467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.833367:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00080000:1.0:1788305788.833917:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305788.840253:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.851963:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994259840 00000100:00100000:0.0:1788305788.851980:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994259840 00000100:00100000:0.0:1788305788.852100:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260864 00000100:00100000:0.0:1788305788.852104:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260864 00000100:00100000:0.0:1788305788.852270:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305788.852306:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305788.852314:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:0:x1875173994259840:12345-192.168.202.55@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788305788.852324:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:15037:x1875173994260864:12345-192.168.202.55@tcp:40:mount.lustre.0 00000004:00000024:0.0:1788305788.852356:0:17153:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788305788.852443:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:15037:x1875173994260864:12345-192.168.202.55@tcp:40:mount.lustre.0 Request processed in 125us (12200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.852451:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305788.857625:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:0:x1875173994259840:12345-192.168.202.55@tcp:41:mount.lustre.0 Request processed in 5307us (27131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305788.857640:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305788.863445:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.863507:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305788.863550:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305788.864256:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994260992 00000100:00100000:1.0:1788305788.864269:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994260992 00000100:00100000:1.0:1788305788.864330:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261120 00000100:00100000:1.0:1788305788.864334:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261120 00000100:00100000:1.0:1788305788.864359:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788305788.864368:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994260992:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788305788.864405:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 41b2c320-efb9-4bcd-bd61-e9037c280b63@192.168.202.55@tcp t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:1.0:1788305788.864435:0:18660:0:(genops.c:1385:class_connect()) connect: client 41b2c320-efb9-4bcd-bd61-e9037c280b63, cookie 0x4a426866e6054b47 00002000:00100000:1.0:1788305788.864448:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 41b2c320-efb9-4bcd-bd61-e9037c280b63/ffff8891bd759800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305788.864461:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305788.864573:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788305788.864660:0:18660:0:(import.c:65:import_set_state_nolock()) ffff8891bd75f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305788.864731:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2394:x1875173994260992:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 361us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.864739:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788305788.864756:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:1.0:1788305788.864761:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2394:x1875173994261120:12345-192.168.202.55@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788305788.864778:0:18660:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 41b2c320-efb9-4bcd-bd61-e9037c280b63@192.168.202.55@tcp t0 exp 0000000000000000 cur 618 last 0 00000020:00000080:1.0:1788305788.864810:0:18660:0:(genops.c:1385:class_connect()) connect: client 41b2c320-efb9-4bcd-bd61-e9037c280b63, cookie 0x4a426866e6054b4e 00002000:00100000:1.0:1788305788.864816:0:18660:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 41b2c320-efb9-4bcd-bd61-e9037c280b63/ffff8891bd75b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788305788.864837:0:18660:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788305788.864888:0:18660:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788305788.864905:0:18660:0:(import.c:65:import_set_state_nolock()) ffff8891bd75c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788305788.864927:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2394:x1875173994261120:12345-192.168.202.55@tcp:8:mount.lustre.0 Request processed in 164us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305788.864934:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:2.0:1788305788.866769:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261248 00000100:00100000:2.0:1788305788.866781:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261248 00000100:00100000:2.0:1788305788.866843:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:2.0:1788305788.866853:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994261248:12345-192.168.202.55@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788305788.866930:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994261248:12345-192.168.202.55@tcp:900:mount.lustre.0 Request processed in 79us (3379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305788.866937:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788305788.874580:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305788.874698:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261376 00000100:00100000:3.0:1788305788.874710:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261376 00000100:00100000:3.0:1788305788.874766:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788305788.874779:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994261376:12345-192.168.202.55@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788305788.874891:0:17155:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788305788.874996:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15037:x1875173994261376:12345-192.168.202.55@tcp:33:mount.lustre.0 Request processed in 220us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305788.875004:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:1.0:1788305788.885738:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788305788.885760:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015316096:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305788.885839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305788.886068:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316096 00000100:00100000:2.0:1788305788.886077:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316096 00000100:00100000:2.0:1788305788.886142:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305788.886160:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015316096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305788.886186:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305788.886244:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015316096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305788.886251:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788305788.886311:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015316096:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788305788.886557:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305789.052624:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305789.052748:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261504 00000100:00100000:0.0:1788305789.052759:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261504 00000100:00100000:0.0:1788305789.052834:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305789.052846:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15070:x1875173994261504:12345-192.168.202.55@tcp:101:mkdir.0 00010000:00010000:0.0:1788305789.052868:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305789.052891:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054b55 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08869 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.052958:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.052972:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.052986:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305789.053032:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788305789.053036:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305789.053057:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.053085:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054b55 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.053106:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305789.053129:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:0.0:1788305789.053132:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788305789.053136:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9000, rc 0) 00000100:00100000:0.0:1788305789.053564:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:15070:x1875173994261504:12345-192.168.202.55@tcp:101:mkdir.0 Request processed in 718us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.053572:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:2.0:1788305789.461581:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305789.909723:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305789.909746:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015316224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305789.909863:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305789.910540:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316224 00000100:00100000:1.0:1788305789.910549:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316224 00000100:00100000:2.0:1788305789.910714:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015316480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305789.910765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.910792:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788305789.910830:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305789.910854:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.910878:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316352 00000100:00100000:2.0:1788305789.910881:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316352 00000100:00100000:2.0:1788305789.910946:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305789.910959:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305789.910996:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305789.911048:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305789.911055:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788305789.911147:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316992:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.911185:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.911200:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015317504:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.911221:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.911236:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015318016:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.911253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.911949:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083792300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305789.911976:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305789.911983:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316864:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912015:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912045:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015317376:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912066:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912086:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015317888:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912128:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912392:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015316736:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912428:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912448:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015317248:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912478:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912495:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015317760:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.912512:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912528:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788305789.912533:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015316608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305789.912549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.912562:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015317120:0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.912707:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316480 00000100:00100000:1.0:1788305789.912715:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316480 00000100:00100000:1.0:1788305789.912730:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316864 00000100:00100000:1.0:1788305789.912732:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316864 00000100:00100000:1.0:1788305789.912744:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305789.912753:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015316224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305789.912792:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305789.912843:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015316224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.912849:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788305789.912862:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305789.912867:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015316480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788305789.912895:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788305789.912944:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015316480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.912950:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788305789.912960:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305789.912965:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.912989:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316864:12345-0@lo:400:kworker.0 Request processed in 25us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.912993:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788305789.913009:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316992 00000100:00100000:1.0:1788305789.913012:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316992 00000100:00100000:1.0:1788305789.913036:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317376 00000100:00100000:1.0:1788305789.913038:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317376 00000100:00100000:1.0:1788305789.913047:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317248 00000100:00100000:1.0:1788305789.913048:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317248 00000100:00100000:1.0:1788305789.913057:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305789.913061:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913087:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015316992:12345-0@lo:400:kworker.0 Request processed in 26us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.913092:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305789.913099:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305789.913104:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015317376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913121:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015317376:12345-0@lo:400:kworker.0 Request processed in 18us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.913126:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788305789.913132:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305789.913138:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015317248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913419:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015317248:12345-0@lo:400:kworker.0 Request processed in 279us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305789.913434:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788305789.913489:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316864:0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913499:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083790700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015317376:0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913506:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788305789.913521:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083790a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015316992:0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.913535:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015316480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305789.913677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.913696:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015317632:0@lo:400:kworker.0 00000100:00100000:2.0:1788305789.913716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305789.913732:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015317248:0@lo:400:kworker.0 00000100:00080000:2.0:1788305789.913750:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305789.913753:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305789.913764:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316608 00000100:00100000:2.0:1788305789.913767:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316608 00000100:00100000:0.0:1788305789.913960:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305789.913969:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305789.913996:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305789.914018:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317504 00000100:00100000:0.0:1788305789.914022:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317504 00000100:00100000:0.0:1788305789.914043:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318016 00000100:00100000:0.0:1788305789.914046:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318016 00000100:00100000:0.0:1788305789.914063:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317888 00000100:00100000:0.0:1788305789.914067:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317888 00000100:00100000:0.0:1788305789.914077:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317760 00000100:00100000:0.0:1788305789.914080:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317760 00000100:00100000:0.0:1788305789.914090:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317120 00000100:00100000:0.0:1788305789.914092:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317120 00000100:00100000:0.0:1788305789.914102:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015317632 00000100:00100000:0.0:1788305789.914104:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015317632 00000100:00100000:0.0:1788305789.914116:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305789.914122:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015317504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914173:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015317504:12345-0@lo:400:kworker.0 Request processed in 51us (2951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914179:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788305789.914190:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305789.914195:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015318016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914233:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015318016:12345-0@lo:400:kworker.0 Request processed in 38us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914239:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788305789.914250:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305789.914256:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015317888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305789.914523:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015317504:0@lo:400:kworker.0 00010000:00080000:1.0:1788305789.914535:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890844fa680 x1875174015318016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305789.914546:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015318016:0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914679:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015317888:12345-0@lo:400:kworker.0 Request processed in 423us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914685:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788305789.914696:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305789.914703:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015317760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914732:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015317760:12345-0@lo:400:kworker.0 Request processed in 31us (2218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914736:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788305789.914745:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305789.914750:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015317120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914771:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015317120:12345-0@lo:400:kworker.0 Request processed in 22us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914775:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788305789.914783:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305789.914788:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015317632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914825:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015317632:12345-0@lo:400:kworker.0 Request processed in 36us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.914830:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788305789.914854:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083793100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015317120:0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.914877:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015317632:0@lo:400:kworker.0 00010000:00080000:0.0:1788305789.914885:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8890844f8e00 x1875174015317760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305789.914892:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015317760:0@lo:400:kworker.0 00000100:00080000:0.0:1788305789.914911:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305789.914914:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305789.915378:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305789.915392:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015316608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305789.915416:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788305789.915477:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015316608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305789.915483:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788305789.915497:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318144 00000100:00100000:2.0:1788305789.915502:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318144 00000100:00100000:2.0:1788305789.915535:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788305789.915539:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305789.915549:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305789.915705:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015316608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305789.915752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015317888:0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.915790:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015316736 00000100:00100000:0.0:1788305789.915794:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015316736 00000100:00100000:0.0:1788305789.915835:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788305789.915841:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015316736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305789.915875:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015316736:12345-0@lo:400:kworker.0 Request processed in 35us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305789.915880:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788305789.915902:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083790e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015316736:0@lo:400:kworker.0 00000100:00100000:3.0:1788305789.916515:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015316224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305789.916759:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1217us (2761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305789.916765:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788305789.916949:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318144:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788305790.488486:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788305790.762983:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788305790.937258:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:0.0:1788305790.937311:0:18655:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000001:00100000:0.0:1788305790.943550:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:0.0:1788305790.943570:0:17132:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00000001:00100000:0.0:1788305790.945357:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00000001:00100000:0.0:1788305790.945367:0:17884:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0f32c93b-849d-4ca6-ae0d-05edb696d5c1 00010000:00010000:2.0:1788305791.510221:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788305792.022789:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788305792.510132:0:20031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788305792.534128:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305793.557578:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305794.009034:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305794.009112:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305794.009303:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318272 00000100:00100000:3.0:1788305794.009312:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318272 00000100:00100000:3.0:1788305794.009375:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788305794.009386:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788305794.009414:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305794.009471:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305794.009479:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788305794.009548:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305794.009583:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788305794.168759:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168806:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168837:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168859:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168878:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168897:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168932:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.168951:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305794.169034:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261888 00000100:00100000:0.0:1788305794.169043:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261888 00000100:00100000:0.0:1788305794.169099:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261760 00000100:00100000:0.0:1788305794.169102:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261760 00000100:00100000:0.0:1788305794.169115:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262272 00000100:00100000:0.0:1788305794.169118:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262272 00000100:00100000:0.0:1788305794.169129:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262400 00000100:00100000:0.0:1788305794.169131:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262400 00000100:00100000:0.0:1788305794.169147:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788305794.169158:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994261888:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169240:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994261888:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 84us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169248:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:0.0:1788305794.169266:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:0.0:1788305794.169309:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994261760:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169349:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994261760:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 76us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169356:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:0.0:1788305794.169368:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:0.0:1788305794.169375:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994262272:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169398:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994262272:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169405:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:0.0:1788305794.169426:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:0.0:1788305794.169433:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994262400:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169456:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994262400:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 24us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169462:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:0.0:1788305794.169482:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262144 00000100:00100000:0.0:1788305794.169486:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262144 00000100:00100000:0.0:1788305794.169506:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262016 00000100:00100000:0.0:1788305794.169509:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262016 00000100:00100000:0.0:1788305794.169522:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262528 00000100:00100000:0.0:1788305794.169524:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262528 00000100:00100000:0.0:1788305794.169535:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262656 00000100:00100000:0.0:1788305794.169537:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262656 00000100:00100000:0.0:1788305794.169550:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788305794.169556:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b9b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994262144:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169580:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b9b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994262144:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169597:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788305794.169711:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305794.169717:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994262016:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169742:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994262016:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 26us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169749:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305794.169760:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305794.169766:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994262528:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169787:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2395:x1875173994262528:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169792:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305794.169802:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788305794.169808:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994262656:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305794.169828:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2395:x1875173994262656:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 20us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305794.169834:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00080000:0.0:1788305794.169873:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305794.169878:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305794.169880:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305794.169882:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305794.170679:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994261632 00000100:00100000:3.0:1788305794.170686:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994261632 00000100:00100000:3.0:1788305794.170735:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 148 00000100:00100000:3.0:1788305794.170743:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2396:x1875173994261632:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305794.170791:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2396:x1875173994261632:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 49us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305794.170798:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 148 00010000:00010000:0.0:1788305794.584019:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305795.029585:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015318400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305795.029698:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.029777:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318400 00000100:00100000:2.0:1788305795.029785:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318400 00000100:00100000:2.0:1788305795.029851:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788305795.029861:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015318400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305795.029884:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305795.029928:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015318400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.029935:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1788305795.029957:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305795.029993:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015318400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305795.030065:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305795.030091:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305795.030109:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318528 00000100:00100000:0.0:1788305795.030114:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318528 00000100:00080000:2.0:1788305795.030136:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305795.030141:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788305795.030148:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015318528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788305795.030181:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788305795.030235:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015318528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305795.030241:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788305795.030467:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015318528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788305795.030848:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788305795.030857:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305795.030884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.032874:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015318784:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.032964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.033003:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015319296:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033029:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.033046:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015319808:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.033088:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788305795.033093:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015319168:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.033142:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015319680:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033161:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305795.033186:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318784 00000100:00100000:1.0:1788305795.033192:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318784 00000100:00100000:1.0:1788305795.033235:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788305795.033243:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015318784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033295:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3650:x1875174015318784:12345-0@lo:400:kworker.0 Request processed in 53us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.033303:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788305795.033329:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319296 00000100:00100000:1.0:1788305795.033332:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319296 00000100:00100000:1.0:1788305795.033354:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305795.033359:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015319296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033384:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015319296:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.033390:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788305795.033405:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319808 00000100:00100000:1.0:1788305795.033420:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319808 00000100:00100000:1.0:1788305795.033449:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319680 00000100:00100000:1.0:1788305795.033451:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319680 00000100:00100000:1.0:1788305795.033468:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305795.033474:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015319808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033499:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1875174015319808:12345-0@lo:400:kworker.0 Request processed in 26us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.033505:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788305795.033514:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305795.033519:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015319680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033548:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083edb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015319680:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.033554:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788305795.033568:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319168 00000100:00100000:1.0:1788305795.033570:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319168 00000100:00100000:1.0:1788305795.033590:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305795.033594:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015319168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033617:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083eda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015319168:12345-0@lo:400:kworker.0 Request processed in 23us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.033622:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788305795.033665:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015319168:0@lo:400:kworker.0 00010000:00080000:1.0:1788305795.033675:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d19500 x1875174015319680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305795.033685:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015319680:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033692:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015318784:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033699:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015319296:0@lo:400:kworker.0 00000100:00100000:1.0:1788305795.033707:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3650:1875174015319808:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.036525:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318656 00000100:00100000:2.0:1788305795.036549:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318656 00000100:00100000:2.0:1788305795.036619:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788305795.036629:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305795.036654:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788305795.036744:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015318656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (5858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.036751:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788305795.036771:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788305795.036776:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788305795.036778:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305795.036795:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015319040:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.036832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.036859:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015319552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.036880:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.036898:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015320064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305795.036923:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.036947:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305795.036954:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015318912:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.036985:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.037004:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015319424:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037023:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.037040:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015319936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.037087:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320064 00000100:00100000:2.0:1788305795.037091:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320064 00000100:00100000:2.0:1788305795.037117:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015318912 00000100:00100000:2.0:1788305795.037127:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015318912 00000100:00100000:2.0:1788305795.037146:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305795.037152:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015320064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305795.037179:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788305795.037214:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015320064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037221:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788305795.037233:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305795.037239:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015318912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037267:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015318912:12345-0@lo:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305795.037267:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015318656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305795.037294:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788305795.037312:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319040 00000100:00100000:2.0:1788305795.037315:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319040 00000100:00100000:2.0:1788305795.037333:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319552 00000100:00100000:2.0:1788305795.037335:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319552 00000100:00100000:2.0:1788305795.037364:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319424 00000100:00100000:2.0:1788305795.037367:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319424 00000100:00100000:2.0:1788305795.037377:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015319936 00000100:00100000:2.0:1788305795.037379:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015319936 00000100:00100000:2.0:1788305795.037392:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305795.037398:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015319040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037441:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875174015319040:12345-0@lo:400:kworker.0 Request processed in 43us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037447:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305795.037465:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305795.037471:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015319552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037501:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015319552:12345-0@lo:400:kworker.0 Request processed in 30us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037513:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788305795.037520:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305795.037523:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788305795.037525:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305795.037531:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015319424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037560:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015319424:12345-0@lo:400:kworker.0 Request processed in 30us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037565:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305795.037576:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305795.037582:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015319936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037607:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015319936:12345-0@lo:400:kworker.0 Request processed in 26us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037613:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305795.037650:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015318912:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037658:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015319424:0@lo:400:kworker.0 00010000:00080000:2.0:1788305795.037668:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083d1a300 x1875174015319936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305795.037678:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015319936:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875174015319040:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015319552:0@lo:400:kworker.0 00000100:00100000:2.0:1788305795.037707:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015320064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305795.037768:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788305795.037775:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015320192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305795.037800:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305795.037831:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320192 00000100:00100000:2.0:1788305795.037836:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320192 00000100:00100000:2.0:1788305795.037855:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305795.037860:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015320192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305795.037877:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788305795.037907:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015320192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305795.037913:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788305795.037936:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015320192:0@lo:41:osp-pre-1-0.0 00000001:00100000:1.0:1788305795.038504:0:19473:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 41b2c320-efb9-4bcd-bd61-e9037c280b63 00010000:00010000:1.0:1788305795.609936:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305796.640105:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788305797.045621:0:20178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde46a8040 20000000:00000080:2.0:1788305797.045640:0:20178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8891b9939000 uarg=0000000000000000 20000000:01000000:2.0:1788305797.045681:0:20178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305797.045687:0:20178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788305797.045693:0:20178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788305797.048445:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788305797.048632:0:20178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788305797.056040:0:20178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788305797.058558:0:20178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058580:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547f1 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058588:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e60547ff expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058614:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605483e expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058622:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e605499c expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058632:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058640:0:20178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058647:0:20178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058693:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058709:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.058725:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320320:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305797.058846:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058855:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.058865:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320448:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305797.058917:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605499c expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.058926:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605499c expref: 23 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.058936:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320576:0@lo:104: 00000100:00100000:3.0:1788305797.058986:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305797.059064:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e605483e expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.059074:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e605483e expref: 23 pid: 17147 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.059082:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320704:0@lo:104: 00000100:00100000:3.0:1788305797.059106:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305797.059144:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.059161:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 23 pid: 17145 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.059170:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320832:0@lo:104: 00000100:00100000:3.0:1788305797.059193:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305797.059212:0:20178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 23 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.059220:0:20178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 23 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.059239:0:20178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320960:0@lo:104: 00000100:00100000:3.0:1788305797.059263:0:20178:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305797.059296:0:20178:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918caed0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305797.060067:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320576 00000100:00100000:1.0:1788305797.060084:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320576 00000100:00100000:1.0:1788305797.060123:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320704 00000100:00100000:1.0:1788305797.060126:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320704 00000100:00100000:1.0:1788305797.060136:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320832 00000100:00100000:1.0:1788305797.060139:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320832 00000100:00100000:1.0:1788305797.060147:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015320960 00000100:00100000:1.0:1788305797.060159:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015320960 00000100:00100000:1.0:1788305797.060174:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305797.060183:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+6:20178:x1875174015320576:12345-0@lo:104: 00010000:00010000:1.0:1788305797.060197:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060302:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788305797.060309:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+6:20178:x1875174015320576:12345-0@lo:104: Request processed in 127us (1324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.060316:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305797.060335:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305797.060342:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+5:20178:x1875174015320704:12345-0@lo:104: 00010000:00010000:1.0:1788305797.060350:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060384:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788305797.060398:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+5:20178:x1875174015320704:12345-0@lo:104: Request processed in 48us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.060405:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305797.060417:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305797.060423:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+4:20178:x1875174015320832:12345-0@lo:104: 00010000:00010000:1.0:1788305797.060431:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060471:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788305797.060476:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+4:20178:x1875174015320832:12345-0@lo:104: Request processed in 54us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.060482:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305797.060495:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305797.060501:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+3:20178:x1875174015320960:12345-0@lo:104: 00010000:00010000:1.0:1788305797.060508:0:17136:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060534:0:17136:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788305797.060539:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:739dca1e-bd16-46de-8d05-a6337c8af843+3:20178:x1875174015320960:12345-0@lo:104: Request processed in 39us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.060544:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788305797.060564:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788305797.060570:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060577:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889183565800 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305797.060581:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060590:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305797.060598:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305797.060605:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305797.060642:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060650:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305797.060671:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060678:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889183565800/0x4a426866e605499c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60549a3 expref: -99 pid: 19472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060692:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788305797.060695:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060701:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50e00 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305797.060704:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060711:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305797.060717:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305797.060723:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305797.060735:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060862:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305797.060891:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060908:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff889083c50e00/0x4a426866e605483e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054845 expref: -99 pid: 18654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060919:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788305797.060922:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060928:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f8000 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305797.060930:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060937:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305797.060944:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305797.060949:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305797.060963:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060969:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305797.060976:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060982:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f8000/0x4a426866e60547ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e6054806 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.060990:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305797.061000:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061006:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9400 already unused, calling callback (ffffffffc13b5c20) 10000000:00010000:1.0:1788305797.061008:0:17140:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061015:0:17140:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788305797.061021:0:17140:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788305797.061027:0:17140:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788305797.061041:0:17140:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061047:0:17140:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788305797.061053:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061059:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e60547f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4a426866e60547f8 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061072:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305797.061074:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305797.061076:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305797.061099:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015321088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788305797.061317:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305797.061488:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015321472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305797.061596:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305797.061663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015321344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305797.061696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305797.061715:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788305797.061722:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015321216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305797.061750:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305797.061778:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321088 00000100:00100000:1.0:1788305797.061784:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321088 00010000:00010000:1.0:1788305797.061808:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605499c expref: 24 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305797.061830:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321344 00000100:00100000:1.0:1788305797.061834:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321344 00010000:00010000:1.0:1788305797.061845:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 25 pid: 17145 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305797.061855:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321216 00000100:00100000:1.0:1788305797.061858:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321216 00010000:00010000:1.0:1788305797.061881:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605483e expref: 26 pid: 17147 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305797.061896:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305797.061904:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+26:3650:x1875174015321088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305797.061915:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305797.061921:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605499c expref: 26 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061930:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605499c expref: 26 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.061947:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305797.061989:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+26:3650:x1875174015321088:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.062001:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788305797.062017:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305797.062022:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+25:3648:x1875174015321344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305797.062031:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305797.062035:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 25 pid: 17145 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.062044:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 25 pid: 17145 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.062054:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305797.062080:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+25:3648:x1875174015321344:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.062086:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788305797.062098:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305797.062104:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3648:x1875174015321216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788305797.062111:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305797.062115:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e605483e expref: 24 pid: 17147 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.062123:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e605483e expref: 24 pid: 17147 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.062132:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305797.062344:0:20178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889183565a00/0x4a426866e60549a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605499c expref: 24 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.062356:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320576:0@lo:104: 00010000:00010000:3.0:1788305797.062367:0:20178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f8400/0x4a426866e6054845 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e605483e expref: 23 pid: 17147 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.062376:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320704:0@lo:104: 00010000:00010000:3.0:1788305797.062385:0:20178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c51c00/0x4a426866e6054806 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60547ff expref: 22 pid: 17145 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.062403:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320832:0@lo:104: 00000100:00100000:3.0:1788305797.062413:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320960:0@lo:104: 00000100:00100000:1.0:1788305797.062681:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3648:x1875174015321216:12345-0@lo:103:ldlm_bl.0 Request processed in 576us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305797.062688:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788305797.062730:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305797.064613:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015321216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305797.064625:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015321344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788305797.064661:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:739dca1e-bd16-46de-8d05-a6337c8af843:3650:1875174015321088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305797.065136:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321472 00000100:00100000:3.0:1788305797.065143:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321472 00010000:00010000:3.0:1788305797.065184:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 21 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.065213:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788305797.065221:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+21:3649:x1875174015321472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788305797.065236:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305797.065241:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 21 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.065270:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 21 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.065307:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083c50000/0x4a426866e60547f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4a426866e60547f1 expref: 21 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.065322:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305797.065378:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:739dca1e-bd16-46de-8d05-a6337c8af843+20:3649:x1875174015321472:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (2648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305797.065385:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788305797.065538:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015321472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788305797.065851:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320320:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305797.067270:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305797.067364:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305797.067562:0:20178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20178:1875174015320448:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305797.067604:0:20178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305797.071088:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262784 00000100:00100000:1.0:1788305797.071103:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262784 00000100:00100000:0.0:1788305797.071261:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994262912 00000100:00100000:0.0:1788305797.071267:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994262912 00010000:00010000:0.0:1788305797.071429:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 14 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305797.071505:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:0.0:1788305797.071514:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+14:2395:x1875173994262912:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305797.071530:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305797.071536:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 14 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305797.071548:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 14 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305797.071565:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21800/0x4a426866e6054af3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087c8 expref: 14 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305797.071580:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305797.071657:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2395:x1875173994262912:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 143us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305797.071664:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00010000:00010000:1.0:1788305797.071859:0:17137:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305797.072522:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:3.0:1788305797.072536:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:2395:x1875173994262784:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305797.072546:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305797.072552:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072564:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072578:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8891903f9e00/0x4a426866e6054b32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08838 expref: 12 pid: 17146 timeout: 727 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072592:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072616:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072631:0:17138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072637:0:17138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072645:0:17138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072652:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072658:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:3.0:1788305797.072663:0:17138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072671:0:17138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072684:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305797.072693:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305797.072750:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:2395:x1875173994262784:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 209us (5477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305797.072757:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00010000:00010000:2.0:1788305797.073730:0:20178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305797.073750:0:20178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305797.073757:0:20178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff889083f21600/0x4a426866e6054b63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305797.653543:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788305798.682489:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305798.957893:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305798.958036:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263040 00000100:00100000:0.0:1788305798.958052:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263040 00000100:00100000:0.0:1788305798.958181:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:0.0:1788305798.958194:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+11:14917:x1875173994263040:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305798.958216:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305798.958236:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8000/0x4a426866e6054b6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08870 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.958267:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8000/0x4a426866e6054b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08870 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.958325:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8000/0x4a426866e6054b6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08870 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.958335:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8000, rc 0) 00000100:00100000:0.0:1788305798.958406:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263040:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 214us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305798.958414:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 150 00000100:00100000:1.0:1788305798.964064:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305798.964525:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263168 00000100:00100000:3.0:1788305798.964540:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263168 00000100:00100000:3.0:1788305798.964614:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:3.0:1788305798.964627:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263168:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305798.964859:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263168:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 225us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305798.964869:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 151 00000100:00100000:2.0:1788305798.968783:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305798.969407:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263296 00000100:00100000:1.0:1788305798.969435:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263296 00000100:00100000:1.0:1788305798.969541:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:1.0:1788305798.969557:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263296:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305798.969791:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263296:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 236us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305798.969800:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 152 00000100:00100000:1.0:1788305798.984210:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305798.984425:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263424 00000100:00100000:0.0:1788305798.984439:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263424 00000100:00100000:0.0:1788305798.984516:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:0.0:1788305798.984529:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+12:14917:x1875173994263424:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305798.984554:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305798.984578:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f8400/0x4a426866e6054b71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08877 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.984636:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f8400/0x4a426866e6054b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08877 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.984652:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f8400/0x4a426866e6054b71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08877 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305798.984664:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8400, rc 0) 00000100:00100000:0.0:1788305798.984745:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:14917:x1875173994263424:12345-192.168.202.55@tcp:101:ll_cfg_requeue.0 Request processed in 218us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305798.984753:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 153 00000100:00100000:2.0:1788305798.990614:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305798.990736:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263552 00000100:00100000:3.0:1788305798.990755:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263552 00000100:00100000:3.0:1788305798.990837:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:3.0:1788305798.990862:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:14917:x1875173994263552:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305798.991037:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:14917:x1875173994263552:12345-192.168.202.55@tcp:501:ll_cfg_requeue.0 Request processed in 189us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305798.991045:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 154 00000100:00100000:3.0:1788305798.996857:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305798.998189:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263680 00000100:00100000:0.0:1788305798.998209:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263680 00000100:00100000:0.0:1788305798.998311:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 155 00000100:00100000:0.0:1788305798.998330:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:14917:x1875173994263680:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788305798.998590:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:14917:x1875173994263680:12345-192.168.202.55@tcp:503:ll_cfg_requeue.0 Request processed in 266us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305798.998601:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 155 10000000:01000000:1.0:1788305799.061349:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788305799.061361:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88908353f800 from 13 10000000:01000000:1.0:1788305799.061379:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788305799.061556:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305799.061573:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305799.061606:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305799.061648:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.061766:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305799.061825:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305799.061981:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321600 00000100:00100000:0.0:1788305799.061993:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321600 00000100:00100000:0.0:1788305799.062064:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788305799.062075:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+20:17149:x1875174015321600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788305799.062091:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305799.062107:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8891903f9200/0x4a426866e6054b7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054b78 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.062131:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8891903f9200/0x4a426866e6054b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054b78 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.062149:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8891903f9200/0x4a426866e6054b7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054b78 expref: 21 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.062158:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9200, rc 0) 00000100:00100000:0.0:1788305799.062215:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.062222:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788305799.062244:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305799.062261:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.062271:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305799.062382:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.062554:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.062574:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788305799.062793:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321728 00000100:00100000:0.0:1788305799.062799:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321728 00000100:00100000:0.0:1788305799.062818:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788305799.062825:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305799.062990:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.062997:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788305799.063041:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.063079:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.063127:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.063156:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305799.064618:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321856 00000100:00100000:1.0:1788305799.064639:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321856 00000100:00100000:1.0:1788305799.064706:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305799.064718:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.065643:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 917us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.065657:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788305799.065765:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305799.070171:0:20251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788305799.080182:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788305799.080666:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788305799.080684:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.080701:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff889083c51e00/0x4a426866e6054b78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b7f expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788305799.080714:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788305799.080718:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8891894cf800 from 13 10000000:01000000:0.0:1788305799.080721:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788305799.080782:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.080830:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305799.080845:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305799.080878:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788305799.080976:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305799.081034:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918670b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788305799.081183:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015321984 00000100:00100000:1.0:1788305799.081192:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015321984 00000100:00100000:1.0:1788305799.081258:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788305799.081270:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+21:17149:x1875174015321984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788305799.081323:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305799.081340:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083c50e00/0x4a426866e6054b8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054b86 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305799.081380:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083c50e00/0x4a426866e6054b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054b86 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305799.081419:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083c50e00/0x4a426866e6054b8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054b86 expref: 22 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305799.081431:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50e00, rc 0) 00000100:00100000:1.0:1788305799.081490:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015321984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.081498:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788305799.081673:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015321984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305799.081690:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.081700:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305799.081780:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.081826:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.081863:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788305799.082023:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322112 00000100:00100000:0.0:1788305799.082027:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322112 00000100:00100000:0.0:1788305799.082059:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788305799.082065:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015322112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788305799.082509:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083c85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015322112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 441us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.082518:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788305799.082598:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.082648:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.082707:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305799.082731:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322240 00000100:00100000:1.0:1788305799.082735:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9540 going to sleep for 11 seconds 00000100:00100000:3.0:1788305799.082736:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322240 00000100:00100000:3.0:1788305799.082776:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788305799.082786:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015322240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305799.082986:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889190efb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015322240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305799.082993:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788305799.083006:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788305799.089462:0:20252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788305799.089710:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788305799.089758:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305799.089774:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.089789:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891903f9400/0x4a426866e6054b86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b8d expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305799.089803:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305799.089806:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff88918c9a0800 from 13 10000000:01000000:2.0:1788305799.089809:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305799.089863:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.089871:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.089884:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305799.089919:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.090013:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.090077:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305799.090155:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322368 00000100:00100000:3.0:1788305799.090165:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322368 00000100:00100000:3.0:1788305799.090231:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788305799.090252:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+22:17149:x1875174015322368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305799.090270:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305799.091011:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f20200/0x4a426866e6054b9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054b94 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.091054:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20200/0x4a426866e6054b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054b94 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.091067:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f20200/0x4a426866e6054b9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054b94 expref: 23 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.091077:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20200, rc 0) 00000100:00100000:3.0:1788305799.091212:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 962us (1198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305799.091221:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788305799.098763:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305799.098816:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.098833:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305799.099044:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305799.099131:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305799.099208:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918453bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305799.099474:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322496 00000100:00100000:1.0:1788305799.099483:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322496 00000100:00100000:1.0:1788305799.099552:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788305799.099567:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.099746:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 183us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.099754:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788305799.099852:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305799.100113:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788305799.100175:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305799.100213:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918453bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305799.100368:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322624 00000100:00100000:2.0:1788305799.100393:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322624 00000100:00100000:2.0:1788305799.100441:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788305799.100450:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.100557:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305799.100564:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788305799.100874:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305799.115873:0:20254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788305799.116684:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788305799.116723:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305799.116741:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.116756:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eb800/0x4a426866e6054b94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054b9b expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788305799.116770:0:17149:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788305799.116774:0:17149:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff889182f56000 from 13 10000000:01000000:2.0:1788305799.116777:0:17149:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788305799.116834:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.116843:0:17149:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.116859:0:17149:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305799.116894:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.116986:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305799.117037:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322752 00000100:00100000:2.0:1788305799.117044:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305799.117049:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322752 00000100:00100000:3.0:1788305799.117113:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788305799.117127:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+23:17149:x1875174015322752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788305799.117171:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305799.117188:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff889083f20600/0x4a426866e6054ba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4a426866e6054ba2 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.117237:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff889083f20600/0x4a426866e6054ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4a426866e6054ba2 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.117249:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff889083f20600/0x4a426866e6054ba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4a426866e6054ba2 expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305799.117260:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20600, rc 0) 00000100:00100000:3.0:1788305799.117341:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015322752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305799.117349:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788305799.117382:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788305799.117542:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.117554:0:17149:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305799.117625:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.117657:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.118533:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305799.118990:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015322880 00000100:00100000:3.0:1788305799.118999:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015322880 00000100:00100000:3.0:1788305799.119881:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788305799.119897:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015322880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788305799.120123:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015322880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (2464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305799.120132:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788305799.120639:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015322880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.120731:0:17149:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015323008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788305799.120802:0:17149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.120850:0:17149:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305799.120917:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323008 00000100:00100000:1.0:1788305799.120925:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323008 00000100:00100000:1.0:1788305799.120982:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788305799.120991:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015323008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788305799.121116:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:17149:x1875174015323008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.121123:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788305799.121216:0:17149:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:739dca1e-bd16-46de-8d05-a6337c8af843:17149:1875174015323008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788305799.125037:0:20255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788305799.125693:0:17149:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788305799.125728:0:17149:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.155@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788305799.125743:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305799.125758:0:17149:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.155@tcp lock: ffff8891bb3eae00/0x4a426866e6054ba2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4a426866e6054ba9 expref: -99 pid: 17149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305799.127361:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015323136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788305799.127631:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305799.127789:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323136 00000100:00100000:2.0:1788305799.127870:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323136 00000100:00100000:2.0:1788305799.127963:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788305799.127977:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015323136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305799.128039:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305799.128092:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015323136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 120us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305799.128101:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788305799.128177:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305799.128231:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8890844f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015323136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788305799.280253:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305799.280365:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305799.280396:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305799.283597:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305799.283643:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305799.284039:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305799.284039:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264192 00000100:00100000:0.0:1788305799.284057:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264192 00000100:00100000:2.0:1788305799.284068:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305799.284143:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264704 00000100:00100000:0.0:1788305799.284149:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264704 00000100:00100000:0.0:1788305799.284167:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264064 00000100:00100000:0.0:1788305799.284171:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264064 00000100:00100000:0.0:1788305799.284195:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:0.0:1788305799.284207:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994264192:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305799.284899:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263936 00000100:00100000:1.0:1788305799.284912:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263936 00000100:00100000:1.0:1788305799.284990:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264448 00000100:00100000:1.0:1788305799.284994:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264448 00000100:00100000:0.0:1788305799.285007:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994264192:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 796us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.285019:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:1.0:1788305799.285021:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994263808 00000100:00100000:1.0:1788305799.285026:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994263808 00000100:00100000:1.0:1788305799.285056:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788305799.285070:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994263936:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305799.285079:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305799.285095:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264704:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305799.285667:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264704:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 575us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.285675:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:0.0:1788305799.285763:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:0.0:1788305799.285773:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994264064:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305799.285804:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994264064:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 34us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.285811:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00080000:0.0:1788305799.285843:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788305799.285848:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788305799.285852:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305799.285855:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305799.286024:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788305799.286034:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264448:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305799.286072:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264448:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 40us (5675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.286079:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788305799.286098:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:0.0:1788305799.286106:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994263808:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305799.286129:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994263808:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 25us (2486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305799.286135:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:1.0:1788305799.288953:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890844f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994263936:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 3868us (8697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.288975:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788305799.289304:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264320 00000100:00100000:1.0:1788305799.289316:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264320 00000100:00080000:0.0:1788305799.289403:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305799.289406:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:1.0:1788305799.289423:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994264320:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305799.289521:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994264320:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 101us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.289529:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:2.0:1788305799.289631:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305799.289709:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264576 00000100:00100000:1.0:1788305799.289714:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264576 00000100:00100000:1.0:1788305799.289768:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788305799.289775:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264576:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305799.289887:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083793480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994264576:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 111us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305799.289895:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:2.0:1788305799.290181:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788305799.704183:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305800.149973:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305800.150100:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.150165:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323264 00000100:00100000:2.0:1788305800.150174:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323264 00000100:00100000:2.0:1788305800.150226:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305800.150237:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015323264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788305800.150298:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788305800.150375:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015323264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.150383:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788305800.150438:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083791c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015323264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305800.151498:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015323392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305800.151566:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305800.152040:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015323520:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305800.152123:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305800.152178:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015324032:0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152211:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305800.152218:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015323648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305800.152238:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015324544:0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.152324:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305800.152332:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305800.152380:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015324160:0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152386:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015325056:0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.152444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305800.152458:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324032 00000100:00100000:0.0:1788305800.152472:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324032 00000100:00100000:1.0:1788305800.152486:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015324672:0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.152517:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305800.152542:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015325184:0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152555:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324544 00000100:00100000:0.0:1788305800.152561:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324544 00000100:00100000:1.0:1788305800.152575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305800.152618:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305800.152634:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015324032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.152637:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324160 00000100:00100000:0.0:1788305800.152699:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015324032:12345-0@lo:400:kworker.0 Request processed in 70us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305800.152706:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788305800.152736:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788305800.152743:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015324544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152772:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015324544:12345-0@lo:400:kworker.0 Request processed in 30us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305800.152778:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788305800.152802:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788305800.152807:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788305800.152820:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324672 00000100:00100000:0.0:1788305800.152823:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324672 00000100:00100000:0.0:1788305800.152848:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015325184 00000100:00100000:0.0:1788305800.152864:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015325184 00000100:00100000:0.0:1788305800.152888:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788305800.152895:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015324672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152932:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1875174015324672:12345-0@lo:400:kworker.0 Request processed in 37us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305800.152938:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788305800.152949:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788305800.152955:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015325184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.152984:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1875174015325184:12345-0@lo:400:kworker.0 Request processed in 29us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305800.152990:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788305800.153010:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305800.153027:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153057:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323520 00000100:00100000:2.0:1788305800.153069:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323520 00000100:00100000:0.0:1788305800.153090:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015324032:0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.153109:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015324544:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153136:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305800.153156:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015323520:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788305800.153157:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015325056 00000100:00100000:0.0:1788305800.153165:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015325056 00000004:00000024:2.0:1788305800.153205:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788305800.153208:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788305800.153245:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324160 00000100:00100000:2.0:1788305800.153336:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015323520:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.153345:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788305800.153384:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323392 00000100:00100000:2.0:1788305800.153388:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323392 00000100:00100000:2.0:1788305800.153412:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323648 00000100:00100000:2.0:1788305800.153415:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323648 00000100:00100000:2.0:1788305800.153428:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305800.153435:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015323392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788305800.153455:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788305800.153490:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015323392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.153496:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788305800.153508:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305800.153514:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015323648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788305800.153526:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788305800.153550:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015323648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.153556:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788305800.153579:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015323904:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153681:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015324416:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153708:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153727:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015324928:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153749:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153783:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015323392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788305800.153803:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788305800.153809:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015323776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305800.153832:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153849:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015324288:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153886:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153906:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015324800:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.153929:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305800.153951:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323904 00000100:00100000:2.0:1788305800.153954:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323904 00000100:00100000:2.0:1788305800.153980:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788305800.153987:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3648:x1875174015323904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.154022:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:739dca1e-bd16-46de-8d05-a6337c8af843+24:3648:x1875174015323904:12345-0@lo:400:kworker.0 Request processed in 35us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.154028:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788305800.154057:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324288 00000100:00100000:2.0:1788305800.154060:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324288 00000100:00100000:3.0:1788305800.154123:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015323776 00000100:00100000:3.0:1788305800.154127:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015323776 00000100:00100000:3.0:1788305800.154147:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305800.154153:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015323776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788305800.154164:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788305800.154194:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083792300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015323776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305800.154206:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788305800.154226:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324928 00000100:00100000:3.0:1788305800.154229:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324928 00000100:00100000:3.0:1788305800.154250:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324800 00000100:00100000:3.0:1788305800.154252:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324800 00000100:00100000:0.0:1788305800.155325:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015325056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.155377:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305800.155398:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015324928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.155456:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1875174015325056:12345-0@lo:400:kworker.0 Request processed in 2234us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305800.155467:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788305800.155491:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083791880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875174015324928:12345-0@lo:400:kworker.0 Request processed in 100us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.155603:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305800.155611:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015324288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.156701:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788305800.156730:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015324160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788305800.156806:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b8e00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015324160:12345-0@lo:400:kworker.0 Request processed in 90us (4371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.158402:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015324288:12345-0@lo:400:kworker.0 Request processed in 2781us (4504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305800.158434:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788305800.158541:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3649:1875174015325056:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.158566:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015323520:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305800.158612:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015323776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788305800.158622:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015324288:0@lo:400:kworker.0 00000100:00100000:2.0:1788305800.158632:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:739dca1e-bd16-46de-8d05-a6337c8af843:3648:1875174015323904:0@lo:400:kworker.0 00010000:00080000:2.0:1788305800.158909:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083ed9180 x1875174015324928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788305800.158922:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3648:1875174015324928:0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.159381:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788305800.159420:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015324416 00000100:00100000:1.0:1788305800.159429:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015324416 00000100:00100000:1.0:1788305800.159486:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305800.159496:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015324416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.159591:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083790700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015324416:12345-0@lo:400:kworker.0 Request processed in 96us (5882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305800.159598:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788305800.159640:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015324416:0@lo:400:kworker.0 00000100:00080000:1.0:1788305800.159695:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788305800.159702:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788305800.159705:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305800.159735:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015323648:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305800.159748:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015324160:0@lo:400:kworker.0 00000100:00100000:1.0:1788305800.159761:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3650:1875174015324672:0@lo:400:kworker.0 00010000:00080000:1.0:1788305800.159777:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083ed9880 x1875174015325184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305816 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788305800.159786:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083ed9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3650:1875174015325184:0@lo:400:kworker.0 00000100:00100000:3.0:1788305800.160184:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305800.160194:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015324800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305800.160244:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875174015324800:12345-0@lo:400:kworker.0 Request processed in 51us (6313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305800.160251:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788305800.160314:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3648:1875174015324800:0@lo:400:kworker.0 00000100:00080000:1.0:1788305800.160393:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305800.165947:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1788305800.726432:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305800.990754:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788305801.631880:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305801.631981:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264832 00000100:00100000:1.0:1788305801.631991:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264832 00000100:00100000:1.0:1788305801.632072:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:1.0:1788305801.632085:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:15586:x1875173994264832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305801.632116:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305801.632136:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054bb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0887e expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632209:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632239:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632252:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632267:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632302:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632310:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632402:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632410:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632417:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305801.632448:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305801.632451:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305801.632487:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632497:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632512:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632518:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632523:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305801.632527:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632535:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632546:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:1.0:1788305801.632549:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305801.632553:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632558:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632571:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632576:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632582:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632587:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305801.632595:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632600:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632608:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff88918c7b0000) 00010000:00010000:1.0:1788305801.632610:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305801.632612:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632618:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632659:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054bb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0887e expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632672:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50600/0x4a426866e6054bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0887e expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.632679:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88918c7b0500) 00010000:00010000:1.0:1788305801.632681:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305801.632683:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50600, rc 0) 00000100:00100000:1.0:1788305801.632746:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15586:x1875173994264832:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 664us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305801.632753:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00080000:0.0:1788305801.633727:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305801.635453:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305801.635554:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994264960 00000100:00100000:2.0:1788305801.635564:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994264960 00000100:00100000:2.0:1788305801.635624:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:2.0:1788305801.635637:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15586:x1875173994264960:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788305801.635732:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15586:x1875173994264960:12345-192.168.202.55@tcp:900:lhsmtool_posix.0 Request processed in 98us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305801.635740:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:1.0:1788305801.641497:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305801.641699:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265216 00000100:00100000:3.0:1788305801.641708:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265216 00000100:00100000:3.0:1788305801.641838:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:3.0:1788305801.641849:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15586:x1875173994265216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305801.642007:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305801.642032:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054bcc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08885 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642116:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642130:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642142:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642232:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642241:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.642249:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.647093:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e6054be1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.647116:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e6054be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.647128:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e6054be1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305801.647142:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788305801.653597:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653616:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653623:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653657:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305801.653662:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653669:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653692:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff88918c7b0500) 00010000:00010000:2.0:1788305801.653695:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305801.653700:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653706:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054bd3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653724:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653730:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653735:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653740:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305801.653742:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653748:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653767:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8890825b9800) 00010000:00010000:2.0:1788305801.653770:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305801.653773:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.653780:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054bda lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.661556:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054bcc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08885 expref: 10 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.661588:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21600/0x4a426866e6054be1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08885 expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.661599:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8890825b9a00) 00010000:00010000:2.0:1788305801.661602:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305801.661606:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f21600, rc 0) 00000100:00100000:2.0:1788305801.661695:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15586:x1875173994265216:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 19847us (20208us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788305801.661703:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 24 00000100:00100000:3.0:1788305801.667498:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305801.675497:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265344 00000100:00100000:1.0:1788305801.675514:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265344 00000100:00100000:1.0:1788305801.675660:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788305801.675687:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15586:x1875173994265344:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788305801.675831:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15586:x1875173994265344:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 141us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305801.675839:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:0.0:1788305801.692765:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305801.694213:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265472 00000100:00100000:1.0:1788305801.694227:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265472 00000100:00100000:1.0:1788305801.694322:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:1.0:1788305801.694336:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15586:x1875173994265472:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1788305801.695395:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788305801.700838:0:17151:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6445us 00000100:00100000:3.0:1788305801.749648:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305801.749784:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265600 00000100:00100000:1.0:1788305801.749795:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265600 00000100:00100000:1.0:1788305801.749850:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:1.0:1788305801.749861:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15592:x1875173994265600:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305801.749884:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305801.749908:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054bef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0888c expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.749979:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.749992:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750003:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750018:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750056:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750063:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750114:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750120:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750126:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750131:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305801.750136:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750152:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750164:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:1.0:1788305801.750167:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305801.750171:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750177:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054bf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750188:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750199:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750204:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750209:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305801.750211:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750217:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750224:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff88918c7b0000) 00010000:00010000:1.0:1788305801.750226:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305801.750228:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750233:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054bfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750265:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054bef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0888c expref: 10 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750296:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:1.0:1788305801.750298:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305801.750302:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054bef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0888c expref: 10 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305801.750321:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50000, rc 0) 00000100:00100000:1.0:1788305801.750395:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15592:x1875173994265600:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 534us (756us total) trans 0 rc 301/301 00000100:00100000:1.0:1788305801.750401:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00010000:00010000:1.0:1788305801.756415:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305801.763766:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15586:x1875173994265472:12345-192.168.202.55@tcp:59:lhsmtool_posix.0 Request processed in 69424us (71002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305801.763781:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:0.0:1788305801.763947:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305801.764072:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265728 00000100:00100000:2.0:1788305801.764080:0:17160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265728 00000100:00100000:3.0:1788305801.765821:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788305801.765851:0:17160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15592:x1875173994265728:12345-192.168.202.55@tcp:700:lfs.0 00000100:00100000:3.0:1788305801.765955:0:17160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15592:x1875173994265728:12345-192.168.202.55@tcp:700:lfs.0 Request processed in 114us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305801.765979:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788305801.772894:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305801.772987:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994265984 00000100:00100000:3.0:1788305801.772999:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994265984 00000100:00100000:3.0:1788305801.773105:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:3.0:1788305801.773124:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:15592:x1875173994265984:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:3.0:1788305801.773189:0:17153:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305801.773216:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054b1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe087f9 expref: 9 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.773237:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:3.0:1788305801.773243:0:17153:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305801.773338:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.773364:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.773373:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.773408:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.773423:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 5 pid: 17151 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305801.773438:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015325312:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305801.773589:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918453bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305801.779804:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305801.779890:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266112 00000100:00100000:2.0:1788305801.779901:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266112 00010000:00010000:2.0:1788305801.779963:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 6 pid: 17151 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305801.780022:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:2.0:1788305801.780032:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994266112:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305801.780048:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305801.780055:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 6 pid: 17151 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.780068:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 6 pid: 17151 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.780092:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:2.0:1788305801.780097:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.780107:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.780125:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305801.780155:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305801.780209:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2396:x1875173994266112:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 179us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305801.780217:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00080000:0.0:1788305801.780421:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788305801.785093:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054b5c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08869 expref: 5 pid: 17151 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305801.785362:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88908209e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015325312:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305801.785390:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.785401:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.785407:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.785435:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.785447:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.785456:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787079:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787100:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787175:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305801.787205:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47d5904 reply state 00000000f8c79b20 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787216:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787223:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:3.0:1788305801.787226:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305801.787231:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788305801.787237:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305801.787245:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787251:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787258:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787264:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305801.787269:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787532:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787544:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88918c7b0a00) 00010000:00010000:3.0:1788305801.787546:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305801.787550:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787569:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c04 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305801.787589:0:17153:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d47d5904 reply state 00000000f8c79b20 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787598:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.787604:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8890825b9d00) 00010000:00010000:3.0:1788305801.787606:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305801.787608:0:17153:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788305801.787747:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+10:15592:x1875173994265984:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 14621us (14921us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788305801.787756:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:1.0:1788305801.952919:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305801.953030:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266240 00000100:00100000:3.0:1788305801.953041:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266240 00000100:00100000:3.0:1788305801.953103:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:3.0:1788305801.953122:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+10:15600:x1875173994266240:12345-192.168.202.55@tcp:101:lctl.0 00010000:00010000:3.0:1788305801.953154:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305801.953181:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08893 expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953249:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953265:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953331:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305801.953387:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305801.953391:0:18524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305801.953442:0:18524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953472:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08893 expref: 12 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953492:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50200/0x4a426866e6054c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08893 expref: 11 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305801.953501:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305801.953503:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305801.953507:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50200, rc 0) 00000100:00100000:3.0:1788305801.953582:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+11:15600:x1875173994266240:12345-192.168.202.55@tcp:101:lctl.0 Request processed in 470us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305801.953588:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000040:00080000:3.0:1788305802.006746:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305802.008684:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.008860:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266368 00000100:00100000:2.0:1788305802.008880:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266368 00000100:00100000:2.0:1788305802.008942:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:2.0:1788305802.008956:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:15601:x1875173994266368:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:2.0:1788305802.008997:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305802.009020:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0889a expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009094:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009460:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009476:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305802.009528:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305802.009532:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305802.009558:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009585:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0889a expref: 7 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009602:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea800/0x4a426866e6054c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0889a expref: 6 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.009611:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:2.0:1788305802.009614:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788305802.009618:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ea800, rc 0) 00000100:00100000:2.0:1788305802.009695:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15601:x1875173994266368:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 742us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305802.009702:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:2.0:1788305802.013953:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.014055:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266496 00000100:00100000:3.0:1788305802.014067:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266496 00000100:00100000:3.0:1788305802.014132:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:3.0:1788305802.014142:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:15601:x1875173994266496:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305802.015014:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305802.015038:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088a1 expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015128:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015142:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015153:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015166:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015173:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015179:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015251:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015260:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015266:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.015471:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788305802.015476:0:18524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305802.015498:0:18524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015523:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015529:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015535:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015540:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c51c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.015544:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015551:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015562:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305802.015565:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305802.015568:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015573:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054c3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015585:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015590:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015595:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015606:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.015609:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015614:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015621:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8890825b9d00) 00010000:00010000:3.0:1788305802.015623:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305802.015697:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015705:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054c43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015734:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088a1 expref: 8 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015746:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088a1 expref: 7 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.015753:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:3.0:1788305802.015755:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305802.015757:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:3.0:1788305802.016457:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:15601:x1875173994266496:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 2311us (2636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305802.016467:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305802.021688:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.021853:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266624 00000100:00100000:2.0:1788305802.021871:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266624 00000100:00100000:2.0:1788305802.021959:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788305802.021972:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:15601:x1875173994266624:12345-192.168.202.55@tcp:900:lfs.0 00000100:00100000:2.0:1788305802.022058:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:15601:x1875173994266624:12345-192.168.202.55@tcp:900:lfs.0 Request processed in 89us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305802.022066:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00080000:0.0:1788305802.022573:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305802.030853:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.031196:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994266880 00000100:00100000:3.0:1788305802.031219:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994266880 00000100:00100000:3.0:1788305802.031318:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788305802.031330:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+7:15601:x1875173994266880:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305802.031379:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305802.031401:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088a8 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.031499:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305802.031606:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c51 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088a8 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.031622:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305802.031632:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305802.031638:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088a8 expref: 9 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.031653:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20800, rc 0) 00000100:00100000:3.0:1788305802.031721:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb096300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+8:15601:x1875173994266880:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 392us (877us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788305802.031728:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788305802.039314:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305802.039528:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994267136 00000100:00100000:1.0:1788305802.039538:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994267136 00000100:00100000:1.0:1788305802.039612:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788305802.039624:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+8:15601:x1875173994267136:12345-192.168.202.55@tcp:36:lfs.0 00010000:00010000:1.0:1788305802.039690:0:17151:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305802.039719:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088a1 expref: 8 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.039739:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:1.0:1788305802.039744:0:17151:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305802.039766:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.039779:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.039789:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788305802.040019:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000076d45b reply state 00000000b14b7474 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.040032:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.040039:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:1.0:1788305802.040042:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788305802.040045:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788305802.040051:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788305802.040141:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+9:15601:x1875173994267136:12345-192.168.202.55@tcp:36:lfs.0 Request processed in 519us (871us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788305802.041024:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:1.0:1788305802.044472:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.044564:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994267392 00000100:00100000:2.0:1788305802.044575:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994267392 00000100:00100000:2.0:1788305802.044635:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305802.044647:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+9:15601:x1875173994267392:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:2.0:1788305802.044906:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+10:15601:x1875173994267392:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 260us (445us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788305802.044915:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305802.049207:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.049376:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994267648 00000100:00100000:3.0:1788305802.049387:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994267648 00000100:00100000:3.0:1788305802.049455:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788305802.049467:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+10:15601:x1875173994267648:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305802.049493:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305802.049515:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088af expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049610:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049626:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049638:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049649:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049656:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049662:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.049768:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305802.049841:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049849:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049856:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049861:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.049866:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049885:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049905:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305802.049909:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305802.049913:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049919:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049933:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049939:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049944:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049950:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.049952:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049959:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049965:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8890825b9d00) 00010000:00010000:3.0:1788305802.049968:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305802.049970:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.049985:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054c74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.050019:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088af expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.050030:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305802.050032:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305802.050036:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054c66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088af expref: 12 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.050045:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20800, rc 0) 00000100:00100000:3.0:1788305802.050357:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+11:15601:x1875173994267648:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 880us (1150us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788305802.050364:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:0.0:1788305802.057614:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305802.058437:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994267776 00000100:00100000:1.0:1788305802.058450:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994267776 00000100:00100000:1.0:1788305802.058517:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:1.0:1788305802.058529:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+11:15601:x1875173994267776:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:1.0:1788305802.058553:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305802.058577:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031a00/0x4a426866e6054c82 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088b6 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.058687:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.058703:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.058714:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788305802.058762:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788305802.058766:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788305802.058789:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.058836:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031a00/0x4a426866e6054c82 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.058856:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.059041:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:1.0:1788305802.059044:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788305802.059048:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031c00, rc 0) 00000100:00100000:1.0:1788305802.059236:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:15601:x1875173994267776:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 708us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305802.059243:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:1.0:1788305802.063428:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.063576:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994267904 00000100:00100000:2.0:1788305802.063587:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994267904 00000100:00100000:2.0:1788305802.063808:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305802.063831:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:15601:x1875173994267904:12345-192.168.202.55@tcp:37:lfs.0 00000100:00100000:2.0:1788305802.081685:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:15601:x1875173994267904:12345-192.168.202.55@tcp:37:lfs.0 Request processed in 17854us (18256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305802.081700:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:3.0:1788305802.090637:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305802.090930:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268160 00000100:00100000:0.0:1788305802.090944:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268160 00000100:00100000:0.0:1788305802.091017:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:0.0:1788305802.091030:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:15601:x1875173994268160:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305802.091696:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826b9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+13:15601:x1875173994268160:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 666us (1068us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788305802.091706:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 4 00000100:00100000:3.0:1788305802.213631:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.213738:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268288 00000100:00100000:2.0:1788305802.213749:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268288 00000100:00100000:2.0:1788305802.213811:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788305802.213853:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+11:15607:x1875173994268288:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305802.213874:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305802.213895:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088bd expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.213965:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.213979:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.213991:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214003:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214011:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214018:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214098:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214121:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214128:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305802.214182:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788305802.214186:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305802.214226:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214239:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214245:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214252:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214258:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305802.214262:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214270:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214327:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:2.0:1788305802.214330:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305802.214336:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214352:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054c97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214367:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214383:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214389:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214394:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305802.214398:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214404:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214414:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8890825b9d00) 00010000:00010000:2.0:1788305802.214417:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305802.214420:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214426:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054c9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214452:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088bd expref: 13 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214467:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb400/0x4a426866e6054ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088bd expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.214475:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:2.0:1788305802.214478:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788305802.214487:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb400, rc 0) 00000100:00100000:2.0:1788305802.214548:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:15607:x1875173994268288:12345-192.168.202.55@tcp:101:bash.0 Request processed in 699us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305802.214558:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:2.0:1788305802.224808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305802.225539:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268416 00000100:00100000:0.0:1788305802.225551:0:17162:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268416 00000100:00100000:0.0:1788305802.225620:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305802.225632:0:17162:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15607:x1875173994268416:12345-192.168.202.55@tcp:900:bash.0 00000100:00100000:0.0:1788305802.225727:0:17162:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:15607:x1875173994268416:12345-192.168.202.55@tcp:900:bash.0 Request processed in 97us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305802.225736:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305802.231521:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305802.231641:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268672 00000100:00100000:1.0:1788305802.231652:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268672 00000100:00100000:1.0:1788305802.231720:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 37 00000100:00100000:1.0:1788305802.231731:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+12:15607:x1875173994268672:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305802.231752:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305802.231773:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031a00/0x4a426866e6054cac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088c4 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.232007:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.232031:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.232040:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.232072:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305802.232084:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 12 pid: 17151 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305802.232097:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1875174015325440:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305802.232501:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788305802.245665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305802.246224:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268800 00000100:00100000:0.0:1788305802.246235:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268800 00010000:00010000:0.0:1788305802.246315:0:19490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 13 pid: 17151 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305802.246361:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 16 00000100:00100000:0.0:1788305802.246371:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+13:2395:x1875173994268800:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305802.246387:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305802.246395:0:19490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 13 pid: 17151 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.246408:0:19490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 13 pid: 17151 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.246433:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:0.0:1788305802.246439:0:19490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.246449:0:19490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.246457:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.246476:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305802.246538:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+13:2395:x1875173994268800:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 168us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305802.246546:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 16 00010000:00010000:3.0:1788305802.253353:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054c89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088b6 expref: 12 pid: 17151 timeout: 732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305802.253387:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb094a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1875174015325440:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305802.253415:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.253426:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.253460:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.253489:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.253503:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.253513:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256765:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256789:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256800:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.256813:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305802.256857:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256865:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256872:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256879:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180030a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.256897:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256905:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256919:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:3.0:1788305802.256922:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305802.256927:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256934:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054cb3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305802.256950:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e9f16d7 reply state 00000000ec72ce2b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256960:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.256967:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8890825b9200) 00010000:00010000:3.0:1788305802.256969:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305802.256972:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788305802.257010:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031a00/0x4a426866e6054cac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.257027:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.257035:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305802.257037:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788305802.257046:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:3.0:1788305802.257147:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+15:15607:x1875173994268672:12345-192.168.202.55@tcp:101:bash.0 Request processed in 25408us (25626us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788305802.257157:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 37 00000040:00080000:1.0:1788305802.263665:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788305802.294118:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.294324:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994268928 00000100:00100000:2.0:1788305802.294337:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994268928 00000100:00100000:2.0:1788305802.294416:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:2.0:1788305802.294428:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+15:15607:x1875173994268928:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305802.294455:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305802.294478:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6054ccf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088cb expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294545:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294558:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294568:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305802.294614:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788305802.294618:0:17152:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305802.294636:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294648:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294670:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea000/0x4a426866e6054ccf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088cb expref: 17 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294704:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088cb expref: 16 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305802.294713:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305802.294716:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788305802.294719:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eb200, rc 0) 00000100:00100000:2.0:1788305802.294770:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+16:15607:x1875173994268928:12345-192.168.202.55@tcp:101:bash.0 Request processed in 345us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305802.294778:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 38 00000100:00100000:2.0:1788305802.304262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305802.304607:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994269184 00000100:00100000:0.0:1788305802.304632:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994269184 00000100:00100000:0.0:1788305802.304686:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788305802.304695:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+16:15607:x1875173994269184:12345-192.168.202.55@tcp:35:bash.0 00000100:00100000:0.0:1788305802.305002:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+17:15607:x1875173994269184:12345-192.168.202.55@tcp:35:bash.0 Request processed in 307us (748us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788305802.305010:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 5 00000100:00100000:0.0:1788305802.456518:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.457646:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994269440 00000100:00100000:3.0:1788305802.457660:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994269440 00000100:00100000:3.0:1788305802.457735:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:3.0:1788305802.457746:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+17:15617:x1875173994269440:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305802.457770:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305802.457792:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054cdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088d2 expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.458841:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305802.458961:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054cdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088d2 expref: 19 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.458979:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305802.458983:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305802.458988:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054cdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088d2 expref: 19 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.459004:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50400, rc 0) 00000100:00100000:3.0:1788305802.459079:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15617:x1875173994269440:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1335us (2570us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788305802.459088:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 39 00000100:00100000:1.0:1788305802.467604:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305802.467704:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994269696 00000100:00100000:0.0:1788305802.467715:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994269696 00000100:00100000:0.0:1788305802.467776:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:0.0:1788305802.467787:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15617:x1875173994269696:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305802.468027:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+19:15617:x1875173994269696:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 240us (443us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788305802.468035:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 6 00000100:00100000:2.0:1788305802.515539:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.515643:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994269952 00000100:00100000:3.0:1788305802.515654:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994269952 00000100:00100000:3.0:1788305802.515728:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:3.0:1788305802.515754:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+19:15620:x1875173994269952:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305802.515779:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305802.515802:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054ceb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088d9 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.515926:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054cf2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.515942:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.515954:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305802.515966:0:17152:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305802.516067:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054ceb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088d9 expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.516087:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088d9 expref: 21 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.516095:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305802.516097:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305802.516101:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:3.0:1788305802.516488:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15620:x1875173994269952:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 734us (957us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788305802.516495:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 40 00000100:00100000:2.0:1788305802.524221:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305802.524261:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.524571:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994270080 00000100:00100000:3.0:1788305802.524581:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994270080 00000100:00100000:3.0:1788305802.524659:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:3.0:1788305802.524669:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15620:x1875173994270080:12345-192.168.202.55@tcp:54:lfs.0 00010000:00010000:3.0:1788305802.524739:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524757:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524768:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524801:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524809:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524827:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524833:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305802.524838:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524846:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524857:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305802.524861:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305802.524865:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305802.524881:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d00 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305802.524954:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15620:x1875173994270080:12345-192.168.202.55@tcp:54:lfs.0 Request processed in 286us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305802.524962:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 41 00000100:00100000:2.0:1788305802.528783:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305802.530637:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994270464 00000100:00100000:3.0:1788305802.530653:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994270464 00000100:00100000:3.0:1788305802.530728:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:3.0:1788305802.530739:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15620:x1875173994270464:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305802.531012:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+22:15620:x1875173994270464:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 274us (2240us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788305802.531020:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 7 00000100:00100000:0.0:1788305802.540380:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994270208 00000100:00100000:0.0:1788305802.540397:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994270208 00000100:00100000:0.0:1788305802.540470:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:0.0:1788305802.540482:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+22:2396:x1875173994270208:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305802.540499:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305802.540526:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054cf2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088d9 expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305802.540548:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305802.540553:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305802.540622:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:2396:x1875173994270208:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 142us (16360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305802.540648:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00010000:00010000:1.0:1788305802.777780:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305803.086171:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305803.086307:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994270720 00000100:00100000:0.0:1788305803.086318:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994270720 00000100:00100000:0.0:1788305803.086413:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:0.0:1788305803.086425:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15651:x1875173994270720:12345-192.168.202.55@tcp:101:cat.0 00010000:00010000:0.0:1788305803.086450:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305803.086471:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088e0 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.086586:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.086600:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.086613:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305803.086625:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788305803.086772:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d07 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e0 expref: 24 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.086792:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e0 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.086801:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305803.086803:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305803.086807:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f8800, rc 0) 00000100:00080000:2.0:1788305803.086964:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305803.087010:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+23:15651:x1875173994270720:12345-192.168.202.55@tcp:101:cat.0 Request processed in 586us (848us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788305803.087017:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 42 00000100:00100000:1.0:1788305803.101372:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305803.101416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305803.101508:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994271104 00000100:00100000:0.0:1788305803.101519:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994271104 00000100:00100000:0.0:1788305803.101600:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:0.0:1788305803.101611:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+23:2397:x1875173994271104:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305803.101628:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305803.101655:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e0 expref: 23 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.101685:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305803.101691:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305803.101750:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+22:2397:x1875173994271104:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 140us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305803.101757:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 1 00000100:00100000:3.0:1788305803.102265:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994270976 00000100:00100000:3.0:1788305803.102271:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994270976 00000100:00100000:3.0:1788305803.102354:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:3.0:1788305803.102363:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+22:15651:x1875173994270976:12345-192.168.202.55@tcp:35:cat.0 00000100:00100000:3.0:1788305803.102637:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+23:15651:x1875173994270976:12345-192.168.202.55@tcp:35:cat.0 Request processed in 275us (1274us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788305803.102644:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 8 00000100:00100000:1.0:1788305803.229792:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305803.229889:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994271360 00000100:00100000:3.0:1788305803.229899:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994271360 00000100:00100000:3.0:1788305803.229960:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:3.0:1788305803.229970:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+23:15657:x1875173994271360:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:3.0:1788305803.230012:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305803.230033:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088e7 expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305803.230149:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305803.230163:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305803.230174:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305803.230186:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305803.230369:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e7 expref: 26 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305803.230387:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e7 expref: 25 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305803.230395:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305803.230398:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305803.230401:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:3.0:1788305803.230462:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15657:x1875173994271360:12345-192.168.202.55@tcp:101:dd.0 Request processed in 493us (680us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788305803.230469:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 43 00000100:00100000:0.0:1788305803.246529:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305803.247002:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994271488 00000100:00100000:2.0:1788305803.247016:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994271488 00000100:00100000:2.0:1788305803.247093:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305803.247106:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:2395:x1875173994271488:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305803.247126:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305803.247162:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088e7 expref: 25 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305803.247186:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305803.247191:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305803.247329:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+24:2395:x1875173994271488:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 224us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305803.247347:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 2 00000100:00100000:2.0:1788305803.261690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305803.261867:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994271616 00000100:00100000:0.0:1788305803.261880:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994271616 00000100:00100000:0.0:1788305803.261966:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:0.0:1788305803.261978:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+24:15657:x1875173994271616:12345-192.168.202.55@tcp:101:dd.0 00010000:00010000:0.0:1788305803.262016:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305803.262038:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d31 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088ee expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262074:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262120:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262132:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262254:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d31 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 26 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262341:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 25 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305803.262352:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305803.262354:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788305803.262358:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891903f9e00, rc 0) 00000100:00100000:0.0:1788305803.262420:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15657:x1875173994271616:12345-192.168.202.55@tcp:101:dd.0 Request processed in 442us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305803.262427:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 44 00000100:00100000:3.0:1788305803.274560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305803.274698:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994271872 00000100:00100000:1.0:1788305803.274710:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994271872 00000100:00100000:1.0:1788305803.274769:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 45 00000100:00100000:1.0:1788305803.274781:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15657:x1875173994271872:12345-192.168.202.55@tcp:36:dd.0 00010000:00010000:1.0:1788305803.274859:0:18524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788305803.274902:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054cd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088cb expref: 25 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305803.274922:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:1.0:1788305803.274927:0:18524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788305803.275251:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305803.275266:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305803.275395:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788305803.275448:0:18524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788305803.275471:0:18524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002352400c reply state 000000001c772abd transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305803.275482:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305803.275489:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:1.0:1788305803.275491:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305803.275494:0:18524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788305803.275593:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+27:15657:x1875173994271872:12345-192.168.202.55@tcp:36:dd.0 Request processed in 814us (1042us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788305803.275601:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 45 00000020:00080000:1.0:1788305803.275606:0:18524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788305803.494645:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305803.494938:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272128 00000100:00100000:3.0:1788305803.494950:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272128 00000100:00100000:3.0:1788305803.495027:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 9 00000100:00100000:3.0:1788305803.495039:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+27:15657:x1875173994272128:12345-192.168.202.55@tcp:35:dd.0 00000100:00100000:3.0:1788305803.495341:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+28:15657:x1875173994272128:12345-192.168.202.55@tcp:35:dd.0 Request processed in 294us (696us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788305803.495350:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 9 00010000:00010000:1.0:1788305803.797572:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788305804.067724:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.067948:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272256 00000100:00100000:0.0:1788305804.067959:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272256 00000100:00100000:0.0:1788305804.068026:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:0.0:1788305804.068037:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+28:15671:x1875173994272256:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:0.0:1788305804.068061:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305804.068083:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088f5 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.068227:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.068253:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.068266:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071619:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071644:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071657:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071752:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071761:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.071768:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788305804.072239:0:17153:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788305804.072245:0:17153:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788305804.072314:0:17153:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072338:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072367:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072374:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072381:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072387:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305804.072392:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072399:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072414:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:0.0:1788305804.072417:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305804.072422:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072428:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9000/0x4a426866e6054d4d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072443:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072449:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072455:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.072466:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891903f9600 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:0.0:1788305804.072470:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075670:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075695:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8890825b9200) 00010000:00010000:0.0:1788305804.075699:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788305804.075704:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075712:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9600/0x4a426866e6054d54 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075772:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f8800/0x4a426866e6054d46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088f5 expref: 30 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075788:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088f5 expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.075795:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305804.075797:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305804.075799:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523bc00, rc 0) 00000100:00100000:0.0:1788305804.075887:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+29:15671:x1875173994272256:12345-192.168.202.55@tcp:101:stat.0 Request processed in 7852us (8173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.075896:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 46 00000100:00100000:1.0:1788305804.229313:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.229605:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272512 00000100:00100000:3.0:1788305804.229617:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272512 00000100:00100000:3.0:1788305804.229679:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 47 00000100:00100000:3.0:1788305804.229690:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+29:15677:x1875173994272512:12345-192.168.202.55@tcp:36:truncate.0 00010000:00010000:3.0:1788305804.229744:0:18524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305804.229772:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523bc00/0x4a426866e6054d5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088f5 expref: 29 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.229791:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.229796:0:18524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305804.229976:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.229990:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.230000:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305804.230044:0:18524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788305804.230065:0:18524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036871163 reply state 00000000744514fb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.230077:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.230103:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.230105:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305804.230108:0:18524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305804.230628:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+31:15677:x1875173994272512:12345-192.168.202.55@tcp:36:truncate.0 Request processed in 936us (1354us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788305804.230636:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 47 00000020:00080000:3.0:1788305804.230640:0:18524:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305804.247056:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015325568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305804.247124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305804.248195:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015325568 00000100:00100000:2.0:1788305804.248208:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015325568 00000100:00100000:2.0:1788305804.248306:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788305804.248318:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015325568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305804.248392:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305804.248468:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015325568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305804.248475:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788305804.248572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015325568:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788305804.250042:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305804.398592:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.398637:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.398665:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.398699:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.398712:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273024 00000100:00100000:2.0:1788305804.398725:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.398731:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273024 00000100:00100000:2.0:1788305804.398742:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.398759:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.398780:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.398787:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273536 00000100:00100000:0.0:1788305804.398791:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273536 00000100:00100000:2.0:1788305804.398794:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272896 00000100:00100000:2.0:1788305804.398796:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272896 00000100:00100000:0.0:1788305804.398816:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273408 00000100:00100000:0.0:1788305804.398819:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273408 00000100:00100000:2.0:1788305804.398823:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:0.0:1788305804.398832:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788305804.398833:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994273024:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305804.398837:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994272896:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305804.398924:0:18658:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788305804.398933:0:18658:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788305804.398950:0:18661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788305804.398960:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788305804.398968:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273536:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305804.399028:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994273024:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 196us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305804.399052:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 27 00000100:00100000:2.0:1788305804.399067:0:18928:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788305804.399074:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305804.399080:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994272896:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 241us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305804.399081:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273408:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305804.399098:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:2.0:1788305804.399103:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273408:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305804.399108:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00080000:0.0:1788305804.399115:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788305804.399118:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305804.399145:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272768 00000100:00100000:0.0:1788305804.399149:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272768 00000100:00080000:0.0:1788305804.399166:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305804.399188:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273280 00000100:00100000:0.0:1788305804.399191:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273280 00000100:00080000:0.0:1788305804.399201:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788305804.399211:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273152 00000100:00100000:0.0:1788305804.399213:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273152 00000100:00080000:0.0:1788305804.399222:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305804.399236:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:0.0:1788305804.399242:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994272768:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305804.399270:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994272768:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 28us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.399305:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994272640 00000100:00100000:3.0:1788305804.399309:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994272640 00000100:00100000:0.0:1788305804.399312:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:0.0:1788305804.399335:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788305804.399342:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273280:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305804.399347:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:3.0:1788305804.399354:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2396:x1875173994272640:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:3.0:1788305804.399374:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2396:x1875173994272640:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 22us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.399374:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273280:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 32us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.399382:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 169 00000100:00100000:0.0:1788305804.399382:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:0.0:1788305804.399394:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:0.0:1788305804.399399:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:2396:x1875173994273152:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305804.399427:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+12:2396:x1875173994273152:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.399434:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 74 00000100:00100000:1.0:1788305804.405672:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2396:x1875173994273536:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 6691us (6958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305804.406035:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:2.0:1788305804.467072:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.467396:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273664 00000100:00100000:3.0:1788305804.467408:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273664 00000100:00100000:3.0:1788305804.467484:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:3.0:1788305804.467495:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+31:15691:x1875173994273664:12345-192.168.202.55@tcp:101:stat.0 00010000:00010000:3.0:1788305804.467521:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305804.467543:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d69 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe088fc expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467615:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467648:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467660:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467674:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467682:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467688:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467776:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467786:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467792:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305804.467844:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788305804.467849:0:18524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305804.467872:0:18524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467885:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467905:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467910:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467917:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467923:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305804.467928:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467936:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467948:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:3.0:1788305804.467951:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305804.467956:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467961:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054d70 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467976:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467981:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467987:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.467998:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305804.468001:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468007:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468014:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8890825b9200) 00010000:00010000:3.0:1788305804.468016:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305804.468019:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468025:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d77 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468052:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054d69 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 33 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468066:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 32 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.468073:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.468075:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305804.468078:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305804.468161:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+32:15691:x1875173994273664:12345-192.168.202.55@tcp:101:stat.0 Request processed in 667us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.468168:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 48 00000100:00100000:2.0:1788305804.570067:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.570303:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994273920 00000100:00100000:3.0:1788305804.570340:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994273920 00000100:00100000:3.0:1788305804.570409:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:3.0:1788305804.570420:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+32:15701:x1875173994273920:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305804.570442:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305804.570464:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08903 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305804.570594:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305804.570706:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08903 expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.570721:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305804.570723:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305804.570728:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054d85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08903 expref: 34 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.570743:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181518c00, rc 0) 00000100:00100000:3.0:1788305804.570813:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083ed8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+33:15701:x1875173994273920:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 395us (755us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788305804.570821:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 49 00000100:00100000:1.0:1788305804.574560:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.574716:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994274176 00000100:00100000:3.0:1788305804.574727:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994274176 00000100:00100000:3.0:1788305804.574790:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:3.0:1788305804.574811:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8890826b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+33:15701:x1875173994274176:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:3.0:1788305804.575041:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8890826b8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+34:15701:x1875173994274176:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 240us (489us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788305804.575049:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 10 00000100:00100000:2.0:1788305804.703964:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.704661:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994274432 00000100:00100000:3.0:1788305804.704673:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994274432 00000100:00100000:2.0:1788305804.705662:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:2.0:1788305804.705675:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+34:15707:x1875173994274432:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305804.705712:0:18524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305804.705734:0:18524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea600/0x4a426866e6054d93 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0890a expref: -99 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705862:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705878:0:18524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 35 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705886:0:18524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705894:0:18524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705943:0:18524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.705958:0:18524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305804.705972:0:18524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18524:1875174015325696:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305804.706072:0:18524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 35 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.706081:0:18524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 35 pid: 17151 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305804.706089:0:18524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb25880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18524:1875174015325824:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305804.706113:0:18524:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2c2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788305804.714723:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305804.714798:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.714885:0:18524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb27480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18524:1875174015325696:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305804.714897:0:18524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb25880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18524:1875174015325824:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305804.714925:0:18524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305804.715269:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994274688 00000100:00100000:0.0:1788305804.715304:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994274688 00010000:00010000:0.0:1788305804.715355:0:19490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 36 pid: 17151 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305804.715393:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994274560 00000100:00100000:0.0:1788305804.715397:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994274560 00010000:00010000:0.0:1788305804.715410:0:19490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 37 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305804.715533:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305804.715542:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:2396:x1875173994274688:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305804.715557:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305804.715565:0:19490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 37 pid: 17151 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715576:0:19490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 37 pid: 17151 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715617:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054cc1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088c4 expref: 37 pid: 17151 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715633:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305804.715638:0:19490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715647:0:19490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715653:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305804.715719:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+36:2396:x1875173994274688:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 178us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.715727:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 17 00000100:00100000:0.0:1788305804.715775:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 18 00000100:00100000:0.0:1788305804.715782:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+35:2396:x1875173994274560:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788305804.715790:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788305804.715795:0:19490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715805:0:19490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715818:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054d7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088fc expref: 35 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715840:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305804.715844:0:19490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715852:0:19490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715860:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.715884:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305804.715906:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+34:2396:x1875173994274560:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 124us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.715913:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 18 00010000:00010000:3.0:1788305804.716269:0:18524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.716296:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305804.716314:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:3.0:1788305804.716457:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea600/0x4a426866e6054d93 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 35 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.716484:0:18524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 34 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.716492:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.716494:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788305804.716497:0:18524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3eaa00, rc 0) 00000100:00100000:3.0:1788305804.716529:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+34:15707:x1875173994274432:12345-192.168.202.55@tcp:101:bash.0 Request processed in 10856us (12573us total) trans 8589934616 rc 0/0 00000100:00100000:3.0:1788305804.716536:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 50 00000100:00100000:1.0:1788305804.719768:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.719954:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994274944 00000100:00100000:3.0:1788305804.719964:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994274944 00000100:00100000:3.0:1788305804.720019:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 51 00000100:00100000:3.0:1788305804.720029:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+34:15707:x1875173994274944:12345-192.168.202.55@tcp:36:bash.0 00010000:00010000:3.0:1788305804.720270:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.720337:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.720362:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788305804.720408:0:17151:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788305804.720430:0:17151:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae019910 reply state 00000000dae287ee transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.720444:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.720452:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.720455:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305804.720458:0:17151:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305804.720560:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15707:x1875173994274944:12345-192.168.202.55@tcp:36:bash.0 Request processed in 531us (801us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788305804.720567:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 51 00000020:00080000:3.0:1788305804.720571:0:17151:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788305804.732054:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305804.733806:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275072 00000100:00100000:2.0:1788305804.733822:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275072 00000100:00100000:2.0:1788305804.733908:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788305804.733920:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15707:x1875173994275072:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305804.733946:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305804.733982:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054daf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08911 expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.734043:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054daf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08911 expref: 38 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.734058:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054daf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08911 expref: 38 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305804.734077:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305804.734091:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788305804.734095:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebe00, rc 0) 00000100:00100000:2.0:1788305804.734169:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88908209f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15707:x1875173994275072:12345-192.168.202.55@tcp:101:bash.0 Request processed in 250us (2127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305804.734176:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 52 00000100:00100000:2.0:1788305804.742930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.743140:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275200 00000100:00100000:3.0:1788305804.743151:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275200 00000100:00100000:3.0:1788305804.743215:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:3.0:1788305804.743227:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15707:x1875173994275200:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:3.0:1788305804.743250:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305804.743271:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054db6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08918 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.743426:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.743461:0:17151:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 39 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.743594:0:17151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.743635:0:17151:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 39 pid: 18524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.743649:0:17151:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 39 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305804.743663:0:17151:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1875174015325952:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305804.743854:0:17151:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788305804.757537:0:17151:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17151:1875174015325952:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305804.757571:0:17151:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305804.762015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.764683:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275328 00000100:00100000:3.0:1788305804.764698:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275328 00010000:00010000:3.0:1788305804.764759:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 40 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305804.764819:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 19 00000100:00100000:3.0:1788305804.764829:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+40:2395:x1875173994275328:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305804.764846:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305804.764868:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 40 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764881:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 40 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764902:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054d9a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0890a expref: 40 pid: 18524 timeout: 734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764918:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.764924:0:17139:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764933:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764939:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.764969:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305804.765026:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+39:2395:x1875173994275328:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 198us (3022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.765035:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 19 00010000:00010000:3.0:1788305804.765062:0:17151:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.765069:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305804.765121:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788305804.765132:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305804.765155:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.765185:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054db6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08918 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.765201:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08918 expref: 38 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.765208:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305804.765211:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788305804.765213:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305804.765241:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15707:x1875173994275200:12345-192.168.202.55@tcp:101:bash.0 Request processed in 22015us (22319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.765248:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 53 00000100:00100000:1.0:1788305804.780393:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.788406:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275584 00000100:00100000:0.0:1788305804.788427:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275584 00000100:00100000:0.0:1788305804.788522:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:0.0:1788305804.788535:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15707:x1875173994275584:12345-192.168.202.55@tcp:103:bash.0 00010000:00010000:0.0:1788305804.788552:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788305804.788579:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054daf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08911 expref: 38 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.788602:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054dbd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08918 expref: 37 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.788613:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305804.788618:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788305804.788717:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+36:15707:x1875173994275584:12345-192.168.202.55@tcp:103:bash.0 Request processed in 185us (8340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.788725:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 3 00000100:00100000:2.0:1788305804.801081:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305804.801359:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275712 00000100:00100000:3.0:1788305804.801370:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275712 00000100:00100000:3.0:1788305804.801439:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:3.0:1788305804.801451:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+36:15707:x1875173994275712:12345-192.168.202.55@tcp:58:bash.0 00010000:00010000:3.0:1788305804.801638:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.801657:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305804.801669:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788305804.807339:0:17152:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788305804.807410:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788305804.807634:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788305804.807773:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+36:15707:x1875173994275712:12345-192.168.202.55@tcp:58:bash.0 Request processed in 6315us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305804.807786:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 54 00000100:00100000:1.0:1788305804.813058:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305804.813125:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275840 00000100:00100000:0.0:1788305804.813144:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275840 00000100:00100000:0.0:1788305804.813218:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 55 00000100:00100000:0.0:1788305804.813232:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+36:15707:x1875173994275840:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:0.0:1788305804.813262:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305804.813338:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0891f expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813420:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813433:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813462:0:17153:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813481:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813500:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:0.0:1788305804.813504:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788305804.813508:0:17153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 37 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305804.813516:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523ac00, rc 0) 00000100:00100000:0.0:1788305804.813622:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15707:x1875173994275840:12345-192.168.202.55@tcp:101:bash.0 Request processed in 392us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305804.813630:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 55 00010000:00010000:1.0:1788305804.821950:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305805.269872:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015326080:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788305805.269950:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305805.270017:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326080 00000100:00100000:0.0:1788305805.270025:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326080 00000100:00100000:0.0:1788305805.270072:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305805.270081:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015326080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788305805.270115:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788305805.270161:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015326080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305805.270168:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788305805.270210:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb26a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015326080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788305805.270429:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015326208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788305805.270472:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305805.270520:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326208 00000100:00100000:2.0:1788305805.270525:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326208 00000100:00100000:2.0:1788305805.270555:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788305805.270563:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015326208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788305805.270583:0:17157:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788305805.270640:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3649:x1875174015326208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.270670:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788305805.270770:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3649:1875174015326208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305805.270795:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788305805.270803:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305805.270859:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.270901:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326336 00000100:00100000:3.0:1788305805.270906:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326336 00000100:00100000:3.0:1788305805.270973:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305805.270982:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015326336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305805.271012:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788305805.271025:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788305805.271365:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015326592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788305805.271407:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305805.271449:0:18662:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788305805.271457:0:18662:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788305805.278831:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015326336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7837us (7958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.278849:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788305805.278887:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326592 00000100:00100000:3.0:1788305805.278896:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326592 00000100:00100000:3.0:1788305805.278956:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788305805.278979:0:18663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015326592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305805.279008:0:18663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788305805.279087:0:18663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015326592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (7679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.279093:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788305805.279115:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305805.279139:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015326720:0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.279213:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.279300:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015326336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305805.279351:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326720 00000100:00100000:3.0:1788305805.279355:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326720 00000100:00100000:3.0:1788305805.279382:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788305805.279388:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015326720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.279425:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015326720:12345-0@lo:400:kworker.0 Request processed in 34us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.279433:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788305805.279477:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015326720:0@lo:400:kworker.0 00000100:00100000:2.0:1788305805.279508:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305805.279522:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015326592:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788305805.279598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.279634:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326464 00000100:00100000:3.0:1788305805.279639:0:18663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326464 00000100:00080000:2.0:1788305805.279722:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788305805.279788:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788305805.280059:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015326464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788305805.280085:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305805.280162:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015326464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.280170:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305805.280403:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015326464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305805.280435:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015326976:0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.280485:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305805.280516:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015327232:0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.280522:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015327488:0@lo:400:kworker.0 00000100:00100000:2.0:1788305805.280760:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326976 00000100:00100000:2.0:1788305805.280769:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326976 00000100:00100000:2.0:1788305805.281498:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788305805.281511:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015326976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.286371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.286454:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788305805.286470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015327104:0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.286521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.286542:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015327616:0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.286568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.286608:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327488 00000100:00100000:3.0:1788305805.286634:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327488 00000100:00100000:3.0:1788305805.286818:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327616 00000100:00100000:3.0:1788305805.286822:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327616 00000100:00100000:3.0:1788305805.286841:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788305805.286851:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015327488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.286910:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875174015327488:12345-0@lo:400:kworker.0 Request processed in 60us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.286918:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788305805.286935:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788305805.286940:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.287026:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875174015327616:12345-0@lo:400:kworker.0 Request processed in 85us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.287033:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788305805.287077:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3647:1875174015327616:0@lo:400:kworker.0 00010000:00080000:3.0:1788305805.287092:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889184025180 x1875174015327488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305805.287104:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3647:1875174015327488:0@lo:400:kworker.0 00000100:00080000:3.0:1788305805.287370:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788305805.287376:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788305805.287415:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327104 00000100:00100000:3.0:1788305805.287419:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327104 00000100:00100000:3.0:1788305805.287451:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305805.287457:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015327104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.287500:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875174015327104:12345-0@lo:400:kworker.0 Request processed in 43us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.287506:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788305805.287540:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184027800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3647:1875174015327104:0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.289463:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015326848:0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.289538:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305805.289581:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015327360:0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.289606:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305805.289647:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015326848 00000100:00100000:1.0:1788305805.289654:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015326848 00000100:00100000:1.0:1788305805.289909:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305805.289919:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015326848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.289984:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015326848:12345-0@lo:400:kworker.0 Request processed in 67us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.290008:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788305805.290053:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015326848:0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.290100:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327360 00000100:00100000:1.0:1788305805.290103:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327360 00000100:00100000:1.0:1788305805.290138:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305805.290145:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015327360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788305805.290177:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1875174015327360:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.290183:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788305805.290203:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3650:1875174015327360:0@lo:400:kworker.0 00000100:00080000:1.0:1788305805.290220:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305805.299073:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305805.299153:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015327744:0@lo:400:kworker.0 00000100:00100000:0.0:1788305805.299197:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305805.300349:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327232 00000100:00100000:3.0:1788305805.300368:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327232 00000100:00100000:3.0:1788305805.300436:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015327744 00000100:00100000:3.0:1788305805.300439:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015327744 00000100:00100000:3.0:1788305805.300477:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788305805.300490:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015327232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.300604:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1875174015327232:12345-0@lo:400:kworker.0 Request processed in 116us (1537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.300612:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788305805.300629:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788305805.300635:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015327744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305805.300662:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1875174015327744:12345-0@lo:400:kworker.0 Request processed in 27us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.300667:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1788305805.300988:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788305805.302169:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875174015326976:12345-0@lo:400:kworker.0 Request processed in 20655us (21677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.302182:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788305805.302458:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875174015326976:0@lo:400:kworker.0 00000100:00100000:0.0:1788305805.309033:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3649:1875174015327232:0@lo:400:kworker.0 00010000:00080000:0.0:1788305805.309061:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889083f1f800 x1875174015327744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305821 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788305805.309101:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3649:1875174015327744:0@lo:400:kworker.0 00000040:00080000:1.0:1788305805.336089:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788305805.336101:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788305805.336133:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788305805.336145:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788305805.336431:0:17185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1875174015327872:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788305805.336553:0:17185:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305805.354137:0:17185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17185:1875174015327872:192.168.202.55@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788305805.360630:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.365115:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994275968 00000100:00100000:1.0:1788305805.365131:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994275968 00000100:00100000:1.0:1788305805.365232:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00100000:1.0:1788305805.365242:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15708:x1875173994275968:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788305805.365292:0:17153:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788305805.365448:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15708:x1875173994275968:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 206us (4828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.365471:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 56 00000100:00080000:2.0:1788305805.366330:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788305805.381437:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.381580:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994276096 00000100:00100000:2.0:1788305805.381597:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994276096 00000100:00100000:2.0:1788305805.381706:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:2.0:1788305805.381719:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15708:x1875173994276096:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788305805.381812:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.381855:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.381871:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387413:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387438:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387451:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387482:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387492:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.387499:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788305805.388894:0:18524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788305805.388902:0:18524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788305805.388925:0:18524:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.388945:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.388982:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.388989:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.388995:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.389001:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389009:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389029:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8890825b9a00) 00010000:00010000:2.0:1788305805.389032:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.389038:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389044:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054dd2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389667:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389677:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389685:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389690:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eaa00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.389706:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389714:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389726:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff88918324a100) 00010000:00010000:2.0:1788305805.389729:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.389732:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389738:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054dd9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389761:0:18524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389767:0:18524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389773:0:18524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389778:0:18524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.389780:0:18524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389786:0:18524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389794:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305805.389796:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.389804:0:18524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.389809:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea400/0x4a426866e6054de0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305805.389988:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb094380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15708:x1875173994276096:12345-192.168.202.55@tcp:34:lhsmtool_posix.0 Request processed in 8264us (8552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.389999:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 57 00000100:00100000:1.0:1788305805.419818:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.419980:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994276352 00000100:00100000:3.0:1788305805.419990:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994276352 00000100:00100000:3.0:1788305805.420048:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:3.0:1788305805.420057:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+37:15708:x1875173994276352:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.420085:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.420105:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054de7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08926 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420223:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420254:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420266:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305805.420303:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788305805.420388:0:17151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420396:0:17151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420403:0:17151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420409:0:17151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.420414:0:17151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420422:0:17151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420434:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305805.420437:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788305805.420440:0:17151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420447:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054dee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420486:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054de7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08926 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420501:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8890825b9a00) 00010000:00010000:3.0:1788305805.420504:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305805.420508:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054de7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08926 expref: 39 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.420517:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305805.420567:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15708:x1875173994276352:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 511us (759us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788305805.420574:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 58 00000100:00100000:0.0:1788305805.426608:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.426678:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994276480 00000100:00100000:2.0:1788305805.426688:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994276480 00000100:00100000:2.0:1788305805.426742:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:2.0:1788305805.426751:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15708:x1875173994276480:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788305805.426785:0:17152:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788305805.426912:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15708:x1875173994276480:12345-192.168.202.55@tcp:53:lhsmtool_posix.0 Request processed in 161us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.426919:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 59 00000100:00100000:3.0:1788305805.432205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305805.432914:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994276736 00000100:00100000:0.0:1788305805.432926:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994276736 00000100:00100000:0.0:1788305805.432992:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:0.0:1788305805.433002:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+38:15708:x1875173994276736:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788305805.433023:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788305805.433045:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b200/0x4a426866e6054dfc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0892d expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788305805.433728:0:17151:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:0.0:1788305805.433736:0:17151:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788305805.433750:0:17151:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788305805.434056:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a800/0x4a426866e6054e03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.434263:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a800/0x4a426866e6054e03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.434429:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a800/0x4a426866e6054e03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.434499:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523b200/0x4a426866e6054dfc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0892d expref: 41 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.434517:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a800/0x4a426866e6054e03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0892d expref: 40 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.434540:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b2400) 00010000:00010000:0.0:1788305805.434543:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788305805.434547:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891a523a800, rc 0) 00000100:00100000:0.0:1788305805.434662:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+40:15708:x1875173994276736:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1660us (2464us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788305805.434672:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 60 00000100:00100000:0.0:1788305805.442923:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.444247:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994276992 00000100:00100000:2.0:1788305805.444259:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994276992 00000100:00100000:2.0:1788305805.444360:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788305805.444371:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+40:15708:x1875173994276992:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305805.444443:0:17152:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305805.444473:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523a800/0x4a426866e6054e03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0892d expref: 40 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444491:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b2400) 00010000:00010000:2.0:1788305805.444501:0:17152:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788305805.444522:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444549:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444559:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444623:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444630:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444637:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444679:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444685:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444691:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444696:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eaa00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.444700:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444706:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444714:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:2.0:1788305805.444722:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.444727:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444733:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eaa00/0x4a426866e6054e11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444743:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444750:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444755:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444760:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ebe00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.444762:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444767:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444775:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x824d6b61 (ffff88918324a100) 00010000:00010000:2.0:1788305805.444777:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.444780:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.444786:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebe00/0x4a426866e6054e18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x824d6b61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305805.444893:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb354000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+39:15708:x1875173994276992:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 524us (1980us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788305805.444907:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 61 00000100:00100000:2.0:1788305805.451672:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.451819:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994277120 00000100:00100000:3.0:1788305805.451830:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994277120 00000100:00100000:3.0:1788305805.451893:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:3.0:1788305805.451904:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+39:15708:x1875173994277120:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.451924:0:17153:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.451950:0:17153:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e1f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08934 expref: -99 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.451984:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054e26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.451997:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.452009:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054e26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.453241:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08934 expref: 41 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.453269:0:17153:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c51c00/0x4a426866e6054e26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08934 expref: 40 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.453326:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.453330:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788305805.453333:0:17153:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c51c00, rc 0) 00000100:00100000:3.0:1788305805.453489:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+40:15708:x1875173994277120:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 1586us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.453497:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 62 00000100:00100000:1.0:1788305805.467990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.468065:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994277376 00000100:00100000:2.0:1788305805.468080:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994277376 00000100:00100000:2.0:1788305805.468142:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:2.0:1788305805.468153:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+40:15708:x1875173994277376:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788305805.468235:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.468252:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.468263:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788305805.468627:0:17152:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1788305805.468637:0:17152:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 635559361205ns, next at 636559358717ns, rc = 0 00000004:00010000:2.0:1788305805.468686:0:17152:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aeaf6de2 reply state 00000000f632fef1 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.468925:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.468936:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:2.0:1788305805.468938:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788305805.468942:0:17152:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788305805.469051:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb097800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+42:15708:x1875173994277376:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 899us (1069us total) trans 8589934621 rc 0/0 00000100:00100000:2.0:1788305805.469067:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 63 00000100:00100000:0.0:1788305805.472249:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.472514:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994277504 00000100:00100000:3.0:1788305805.472525:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994277504 00000100:00100000:3.0:1788305805.472576:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:3.0:1788305805.472587:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+42:15708:x1875173994277504:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.472611:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.472630:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0893b expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.472687:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 43 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.472701:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 43 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.472737:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.472740:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788305805.472744:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083c50800, rc 0) 00000100:00100000:3.0:1788305805.473141:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb357b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+43:15708:x1875173994277504:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 553us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.473148:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 64 00000100:00100000:0.0:1788305805.477818:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.478047:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994277632 00000100:00100000:1.0:1788305805.478058:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994277632 00000100:00100000:1.0:1788305805.478137:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:1.0:1788305805.478149:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2396:x1875173994277632:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788305805.479255:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2396:x1875173994277632:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 1103us (1440us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788305805.479267:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 25 00000100:00100000:2.0:1788305805.485472:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.485669:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994277888 00000100:00100000:3.0:1788305805.485679:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994277888 00000100:00100000:3.0:1788305805.485734:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:3.0:1788305805.485744:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+43:15708:x1875173994277888:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788305805.486345:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+44:15708:x1875173994277888:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 599us (1463us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788305805.486355:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 11 00000100:00100000:0.0:1788305805.491982:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.492606:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278144 00000100:00100000:3.0:1788305805.492618:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278144 00000100:00100000:3.0:1788305805.492684:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:3.0:1788305805.492695:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+44:15708:x1875173994278144:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305805.492855:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+44:15708:x1875173994278144:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 160us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.492862:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 65 00000100:00100000:0.0:1788305805.498211:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.498580:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278272 00000100:00100000:3.0:1788305805.498591:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278272 00000100:00100000:3.0:1788305805.498651:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:3.0:1788305805.498660:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+44:15708:x1875173994278272:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.498693:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.498717:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054e3b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08942 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498782:0:17151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498811:0:17151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498822:0:17151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305805.498869:0:17151:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788305805.498888:0:17151:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498923:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519a00/0x4a426866e6054e3b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08942 expref: 46 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498942:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08942 expref: 45 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.498950:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.498953:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788305805.498957:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889083f20800, rc 0) 00000100:00100000:3.0:1788305805.499031:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+45:15708:x1875173994278272:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 369us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.499039:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 66 00000100:00100000:1.0:1788305805.520044:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.520351:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278400 00000100:00100000:3.0:1788305805.520362:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278400 00000100:00100000:3.0:1788305805.520469:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:3.0:1788305805.520485:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994278400:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.520505:0:18928:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.520525:0:18928:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08949 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788305805.520550:0:18928:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97618d, blocks: 0x0 00010000:00010000:3.0:1788305805.520571:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=635s v=(0 0) 00010000:00010000:3.0:1788305805.520576:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305805.520586:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 7 pid: 18928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.520657:0:18928:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 7 pid: 18928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.520671:0:18928:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181519a00, rc 0) 00000100:00100000:3.0:1788305805.520731:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2395:x1875173994278400:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 250us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.520738:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 26 00000100:00100000:0.0:1788305805.527112:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.527340:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278656 00000100:00100000:3.0:1788305805.527351:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278656 00000100:00100000:3.0:1788305805.527417:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:3.0:1788305805.527428:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+45:15708:x1875173994278656:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788305805.527544:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+45:15708:x1875173994278656:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 118us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.527566:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 67 00000100:00100000:0.0:1788305805.538547:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.538683:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278784 00000100:00100000:3.0:1788305805.538692:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278784 00000100:00100000:3.0:1788305805.538849:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 68 00000100:00100000:3.0:1788305805.538861:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+45:15708:x1875173994278784:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788305805.542349:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1788305805.542369:0:17132:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788305805.542483:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542501:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542509:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542515:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f21800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.542520:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305805.542522:0:17132:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788305805.542537:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542563:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8890825b9d00) 00010000:00010000:3.0:1788305805.542567:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305805.542573:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542579:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f21800/0x4a426866e6054c0b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542607:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542627:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542633:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542638:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083f20400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.542641:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542647:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542656:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:3.0:1788305805.542658:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305805.542661:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542666:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20400/0x4a426866e6054c12 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542681:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542686:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542691:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542696:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.542705:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542711:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542720:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8890825b9200) 00010000:00010000:3.0:1788305805.542722:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305805.542725:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542730:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50000/0x4a426866e6054cba lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542745:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542751:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542756:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542762:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180030a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.542765:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542770:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542777:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305805.542780:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305805.542870:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542949:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180030a00/0x4a426866e6054d3f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542969:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542979:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542987:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.542992:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889083c50400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.543006:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.543009:0:3649:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788305805.543023:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543034:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305805.543037:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788305805.543042:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015328000:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788305805.543043:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543134:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50400/0x4a426866e6054d62 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543150:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.543158:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788305805.543168:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543183:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543189:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181518c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.543192:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543198:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543210:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:3.0:1788305805.543212:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788305805.543217:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543222:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181518c00/0x4a426866e6054da8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.543226:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015328000 00000100:00100000:1.0:1788305805.543237:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015328000 00010000:00010000:3.0:1788305805.543238:0:3634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543247:0:3634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543254:0:3634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543259:0:3634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb000 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:3.0:1788305805.543261:0:3634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.543341:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788305805.543350:0:3634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.543360:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3649:x1875174015328000:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1788305805.543374:0:3634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.543379:0:3634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788305805.543382:0:3634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.543387:0:3634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb000/0x4a426866e6054e2d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.543547:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+14:15708:x1875173994278784:12345-192.168.202.55@tcp:44:lhsmtool_posix.0 Request processed in 4681us (5003us total) trans 0 rc 0/0 00002000:00010000:1.0:1788305805.543550:0:20293:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788305805.543562:0:20293:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788305805.543568:0:20293:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1788305805.543569:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 68 00002000:00010000:1.0:1788305805.543576:0:20293:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788305805 -> 1788305805 00002000:00010000:1.0:1788305805.543581:0:20293:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788305805.543630:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3649:x1875174015328000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 276us (477us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788305805.543646:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00080000:1.0:1788305805.543712:0:3649:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8891903d6300/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788305805.543719:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3649:1875174015328000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788305805.549663:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305805.549901:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994278912 00000100:00100000:0.0:1788305805.549922:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994278912 00000100:00100000:0.0:1788305805.550199:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 28 00000100:00100000:0.0:1788305805.550214:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2395:x1875173994278912:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788305805.550386:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2395:x1875173994278912:12345-192.168.202.55@tcp:16:lhsmtool_posix.0 Request processed in 175us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305805.550396:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 28 00010000:00010000:2.0:1788305805.551785:0:3633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551803:0:3633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551812:0:3633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551820:0:3633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.551825:0:3633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551834:0:3633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551855:0:3633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:2.0:1788305805.551858:0:3633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788305805.551864:0:3633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.551881:0:3633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031400/0x4a426866e6054c5f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17151 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305805.557501:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.557579:0:18524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279168 00000100:00100000:3.0:1788305805.557590:0:18524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279168 00000100:00100000:3.0:1788305805.557648:0:18524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788305805.557662:0:18524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+14:15708:x1875173994279168:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.557732:0:18524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305805.557776:0:18524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083f20800/0x4a426866e6054e42 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08942 expref: 14 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.557804:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.557809:0:18524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788305805.557839:0:18524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.557852:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.557878:0:18524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788305805.558366:0:18524:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9d8f582 reply state 00000000eaaa7682 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.558384:0:18524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682a00/0x4a426866e6054e50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.558390:0:18524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.558393:0:18524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788305805.558396:0:18524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788305805.558515:0:18524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+15:15708:x1875173994279168:12345-192.168.202.55@tcp:36:lhsmtool_posix.0 Request processed in 857us (1023us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788305805.558522:0:18524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 69 00000100:00100000:3.0:1788305805.562195:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.562324:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279296 00000100:00100000:1.0:1788305805.562333:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279296 00000100:00100000:1.0:1788305805.562393:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 29 00000100:00100000:1.0:1788305805.562403:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15708:x1875173994279296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788305805.562422:0:18658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305805.562441:0:18658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08950 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.562471:0:18658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 8 pid: 18928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.562479:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305805.562483:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305805.562488:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.562523:0:18658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 8 pid: 18928 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.562537:0:18658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 8 pid: 18928 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.562568:0:18658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18658:1875174015328128:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305805.562659:0:18658:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788305805.572454:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.572573:0:18658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18658:1875174015328128:192.168.202.55@tcp:104: 00010000:00010000:1.0:1788305805.572611:0:18658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.572633:0:18658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031400, rc 0) 00000100:00100000:3.0:1788305805.572780:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279424 00000100:00100000:3.0:1788305805.572794:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279424 00010000:00010000:3.0:1788305805.572829:0:17139:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 9 pid: 18928 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.572871:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305805.572882:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:2396:x1875173994279424:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305805.572895:0:17139:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305805.572916:0:17139:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 9 pid: 18928 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.572951:0:17139:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 9 pid: 18928 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.572973:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035abbc1a/0x4a426866e6054e49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08949 expref: 9 pid: 18928 timeout: 735 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.572987:0:17139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788305805.572991:0:17139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788305805.573486:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:15708:x1875173994279296:12345-192.168.202.55@tcp:101:lhsmtool_posix.0 Request processed in 11080us (11298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.573495:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 29 00010000:00010000:3.0:1788305805.573618:0:17139:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.573630:0:17139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.574439:0:17139:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 7 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.574459:0:17139:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17139:1875174015328256:192.168.202.55@tcp:105: 00000100:00100000:1.0:1788305805.574531:0:17139:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788305805.579722:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.579954:0:17139:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:17139:1875174015328256:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788305805.579979:0:17139:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788305805.580052:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2396:x1875173994279424:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 7171us (7607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.581690:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 20 00000100:00100000:3.0:1788305805.581882:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279552 00000100:00100000:3.0:1788305805.581891:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279552 00000100:00100000:3.0:1788305805.581939:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:3.0:1788305805.581949:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2396:x1875173994279552:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788305805.582136:0:18660:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788305805.582140:0:18660:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788305804 00002000:00010000:3.0:1788305805.582142:0:18660:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788305801 00002000:00010000:3.0:1788305805.582145:0:18660:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788305805 -> 1788305804 00002000:00010000:3.0:1788305805.582147:0:18660:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788305805.582212:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889083e64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:2396:x1875173994279552:12345-192.168.202.55@tcp:2:lhsmtool_posix.0 Request processed in 263us (2498us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788305805.582233:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 30 00000100:00100000:0.0:1788305805.595013:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.595374:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279680 00000100:00100000:1.0:1788305805.595385:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279680 00000100:00100000:1.0:1788305805.595451:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305805.595477:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:2395:x1875173994279680:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788305805.595524:0:18928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.595546:0:18928:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.595556:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305805.595560:0:18928:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788305805.595565:0:18928:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.595602:0:18928:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.595617:0:18928:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 8 pid: 18658 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.595633:0:18928:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18928:1875174015328384:192.168.202.55@tcp:104: 00000100:00100000:1.0:1788305805.595724:0:18928:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb2d9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788305805.608627:0:18928:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:18928:1875174015328384:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305805.608664:0:18928:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788305805.619391:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.619485:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994279808 00000100:00100000:3.0:1788305805.619495:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994279808 00010000:00010000:3.0:1788305805.619533:0:19490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 9 pid: 18658 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.619577:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 21 00000100:00100000:3.0:1788305805.619588:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+9:2396:x1875173994279808:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305805.619603:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305805.619626:0:19490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 9 pid: 18658 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.619641:0:19490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 9 pid: 18658 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.619664:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac36bfd2/0x4a426866e6054e57 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08950 expref: 9 pid: 18658 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.619682:0:19490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305805.619686:0:19490:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788305805.619707:0:19490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.619717:0:19490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.619742:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788305805.619808:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:2396:x1875173994279808:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 221us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.619816:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 21 00010000:00010000:1.0:1788305805.619939:0:18928:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.619950:0:18928:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.619984:0:18928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.619991:0:18928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.620011:0:18928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.620017:0:18928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305805.620021:0:18928:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.620029:0:18928:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.620041:0:18928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.620048:0:18928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18928 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.620111:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:2395:x1875173994279680:12345-192.168.202.55@tcp:1:lhsmtool_posix.0 Request processed in 24636us (25119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.620128:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 31 00000100:00100000:1.0:1788305805.623916:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.624004:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280064 00000100:00100000:3.0:1788305805.624014:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280064 00000100:00100000:3.0:1788305805.624089:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 70 00000100:00100000:3.0:1788305805.624098:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+15:15708:x1875173994280064:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788305805.624192:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.624209:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.624219:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.624253:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.624268:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 15 pid: 17153 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.625041:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015328512:192.168.202.55@tcp:104: 00000100:00100000:2.0:1788305805.629568:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65240 going to sleep for 11 seconds 00000100:00100000:2.0:1788305805.636718:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184025880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015328512:192.168.202.55@tcp:104: 00010000:00010000:2.0:1788305805.636747:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.639122:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.639258:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280192 00000100:00100000:2.0:1788305805.639324:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280192 00010000:00010000:2.0:1788305805.639362:0:17138:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 16 pid: 17153 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305805.639400:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 22 00000100:00100000:2.0:1788305805.639409:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+16:2396:x1875173994280192:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788305805.639424:0:17138:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788305805.639430:0:17138:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 16 pid: 17153 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639443:0:17138:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 16 pid: 17153 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639465:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891903f9e00/0x4a426866e6054d38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe088ee expref: 16 pid: 17153 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639481:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305805.639487:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 15 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639497:0:17138:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639504:0:17138:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639512:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.639553:0:17138:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788305805.639594:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+15:2396:x1875173994280192:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 186us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.639601:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 22 00010000:00010000:3.0:1788305805.639706:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639715:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639924:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639935:0:17153:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639944:0:17153:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639970:0:17153:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 15 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.639982:0:17153:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 15 pid: 17151 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.639995:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015328640:192.168.202.55@tcp:104: 00000100:00100000:3.0:1788305805.640040:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891baf65d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788305805.644961:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889184026680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015328640:192.168.202.55@tcp:104: 00010000:00010000:3.0:1788305805.644992:0:17153:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.650257:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.650729:0:19490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280320 00000100:00100000:3.0:1788305805.650739:0:19490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280320 00010000:00010000:3.0:1788305805.650795:0:19490:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 16 pid: 17151 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.650835:0:19490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 23 00000100:00100000:3.0:1788305805.650845:0:19490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88919cba0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+16:2396:x1875173994280320:12345-192.168.202.55@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788305805.650861:0:19490:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788305805.650869:0:19490:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 16 pid: 17151 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650883:0:19490:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 16 pid: 17151 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650903:0:19490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889083c50800/0x4a426866e6054e34 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0893b expref: 16 pid: 17151 timeout: 735 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650920:0:19490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:3.0:1788305805.650925:0:19490:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650936:0:19490:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650944:0:19490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.650978:0:19490:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788305805.651144:0:17153:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788305805.651153:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788305805.651259:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788305805.651410:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788305805.651444:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788305805.651521:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17153:1875174015328768:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788305805.651581:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788305805.651627:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff88918664d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788305805.651855:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015328768 00000100:00100000:2.0:1788305805.651860:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015328768 00000100:00100000:2.0:1788305805.651904:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788305805.651912:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17153:x1875174015328768:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788305805.652015:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17153:x1875174015328768:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.652023:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788305805.652325:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff88918caa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17153:1875174015328768:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788305805.652488:0:17153:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788305805.652541:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17153:1875174015328896:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788305805.652575:0:17153:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305805.652606:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4decc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788305805.652984:0:19490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88919cba0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+19:2396:x1875173994280320:12345-192.168.202.55@tcp:103:ldlm_bl.0 Request processed in 2137us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.653098:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015328896 00000100:00100000:2.0:1788305805.653103:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015328896 00000100:00100000:2.0:1788305805.653136:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788305805.653144:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17153:x1875174015328896:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788305805.653254:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17153:x1875174015328896:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (677us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788305805.653261:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788305805.654212:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17153:1875174015328896:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788305805.654264:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788305805.655876:0:19490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 23 00010000:00010000:1.0:1788305805.656254:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656266:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656296:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683800 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305805.656301:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656319:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656338:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:1.0:1788305805.656341:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305805.656363:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656369:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683800/0x4a426866e6054e6c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656405:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656412:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656417:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656423:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181519400 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305805.656425:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656431:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656439:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:1.0:1788305805.656441:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788305805.656450:0:17153:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656460:0:17153:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656469:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.656554:0:17153:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8891a523ac00/0x4a426866e6054dcb lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0891f expref: 18 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788305805.656570:0:17153:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015329024:192.168.202.55@tcp:105: 00000100:00100000:1.0:1788305805.656656:0:17153:0:(client.c:2715:ptlrpc_set_wait()) set ffff8891bb4decc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788305805.679943:0:17153:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17153:1875174015329024:192.168.202.55@tcp:105: 00010000:00010000:1.0:1788305805.679976:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.679986:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181519400/0x4a426866e6054dc4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680034:0:17153:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680047:0:17153:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680068:0:17153:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680080:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680086:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680091:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680116:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889180031c00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305805.680120:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680127:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680141:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:1.0:1788305805.680144:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788305805.680147:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680154:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889180031c00/0x4a426866e6054e73 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680165:0:17153:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680172:0:17153:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680179:0:17153:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680185:0:17153:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181683a00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:1.0:1788305805.680188:0:17153:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680194:0:17153:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680212:0:17153:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:1.0:1788305805.680215:0:17153:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788305805.680218:0:17153:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.680224:0:17153:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181683a00/0x4a426866e6054e65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17153 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788305805.680827:0:17185:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788305805.680834:0:17185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788305805.680865:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788305805.680874:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788305805.681367:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15708:x1875173994280064:12345-192.168.202.55@tcp:57:lhsmtool_posix.0 Request processed in 57263us (57453us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788305805.681379:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 70 00000020:00080000:1.0:1788305805.681385:0:17153:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788305805.686681:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.687709:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280448 00000100:00100000:3.0:1788305805.687722:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280448 00000100:00100000:3.0:1788305805.687799:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:3.0:1788305805.687810:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15707:x1875173994280448:12345-192.168.202.55@tcp:49:bash.0 00000100:00100000:3.0:1788305805.687942:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15707:x1875173994280448:12345-192.168.202.55@tcp:49:bash.0 Request processed in 133us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305805.687951:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 12 00000100:00100000:0.0:1788305805.697714:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305805.697771:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305805.697867:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280832 00000100:00100000:1.0:1788305805.697877:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280832 00000100:00100000:1.0:1788305805.697942:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:1.0:1788305805.697953:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+7:15707:x1875173994280832:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:1.0:1788305805.697971:0:18658:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788305805.697991:0:18658:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e7a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08957 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788305805.698026:0:18658:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a97618c, atime: 0x6a976189, ctime: 0x6a97618c, blocks: 0x0 00010000:00010000:1.0:1788305805.698049:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=635s v=(0 0) 00010000:00010000:1.0:1788305805.698054:0:18658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788305805.698080:0:18658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08957 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.698096:0:18658:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff2a2b83/0x4a426866e6054e7a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08957 expref: 8 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.698124:0:18658:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889180031c00, rc 0) 00000100:00100000:1.0:1788305805.698170:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:15707:x1875173994280832:12345-192.168.202.55@tcp:101:bash.0 Request processed in 219us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305805.698177:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 32 00000100:00100000:3.0:1788305805.698907:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280704 00000100:00100000:3.0:1788305805.698915:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280704 00000100:00100000:3.0:1788305805.698959:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 13 00000100:00100000:3.0:1788305805.698967:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+18:15708:x1875173994280704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788305805.699254:0:17155:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788305805.699332:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788305805.699365:0:17155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699380:0:17155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699391:0:17155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699398:0:17155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699404:0:17155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699423:0:17155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.699434:0:17155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788305805.699505:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+20:15708:x1875173994280704:12345-192.168.202.55@tcp:35:lhsmtool_posix.0 Request processed in 538us (1801us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788305805.699512:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 13 00000020:00080000:3.0:1788305805.699515:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788305805.700384:0:17140:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788305805.700393:0:17140:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.700401:0:17140:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff889181682600 already unused, calling callback (ffffffffc0db8230) 00010000:00010000:1.0:1788305805.700406:0:17140:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.700414:0:17140:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.700430:0:17140:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8890825b9500) 00010000:00010000:1.0:1788305805.700434:0:17140:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788305805.700438:0:17140:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.700444:0:17140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682600/0x4a426866e6054e81 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17155 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788305805.700461:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305805.700463:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788305805.700465:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305805.715721:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.715927:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994280960 00000100:00100000:2.0:1788305805.715937:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994280960 00000100:00100000:2.0:1788305805.716002:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:2.0:1788305805.716013:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+20:15707:x1875173994280960:12345-192.168.202.55@tcp:101:bash.0 00010000:00010000:2.0:1788305805.716034:0:17152:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788305805.716056:0:17152:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054e88 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe0895e expref: -99 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716126:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebc00/0x4a426866e6054e8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716139:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebc00/0x4a426866e6054e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716162:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebc00/0x4a426866e6054e8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716534:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054e88 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0895e expref: 22 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716557:0:17152:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ebc00/0x4a426866e6054e8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe0895e expref: 21 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.716565:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305805.716568:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788305805.716572:0:17152:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8891bb3ebc00, rc 0) 00000100:00100000:2.0:1788305805.716630:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15707:x1875173994280960:12345-192.168.202.55@tcp:101:bash.0 Request processed in 618us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.716637:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 71 00000100:00100000:2.0:1788305805.722303:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305805.722383:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994281216 00000100:00100000:0.0:1788305805.722394:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994281216 00000100:00100000:0.0:1788305805.722448:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 14 00000100:00100000:0.0:1788305805.722458:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+21:15707:x1875173994281216:12345-192.168.202.55@tcp:35:bash.0 00000001:00080000:0.0:1788305805.722667:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:0.0:1788305805.722742:0:17155:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:0.0:1788305805.723557:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+24:15707:x1875173994281216:12345-192.168.202.55@tcp:35:bash.0 Request processed in 1095us (1277us total) trans 8589934633 rc 0/0 00000100:00100000:0.0:1788305805.723568:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 14 00000020:00080000:0.0:1788305805.723582:0:17155:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788305805.851442:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788305805.915696:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305805.915881:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994281472 00000100:00100000:3.0:1788305805.915895:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994281472 00000100:00100000:3.0:1788305805.915988:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:3.0:1788305805.916001:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+24:15718:x1875173994281472:12345-192.168.202.55@tcp:101:lfs.0 00010000:00010000:3.0:1788305805.916035:0:17151:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788305805.916064:0:17151:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff889181682800/0x4a426866e6054e96 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4f79de82fbe08965 expref: -99 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788305805.916550:0:17151:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788305805.916688:0:17151:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff889181682800/0x4a426866e6054e96 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08965 expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.916708:0:17151:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8890825b9e00) 00010000:00010000:3.0:1788305805.916711:0:17151:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788305805.916717:0:17151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff889181682800/0x4a426866e6054e96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.55@tcp remote: 0x4f79de82fbe08965 expref: 26 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788305805.916735:0:17151:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff889181682800, rc 0) 00000100:00100000:3.0:1788305805.917705:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15718:x1875173994281472:12345-192.168.202.55@tcp:101:lfs.0 Request processed in 1702us (2019us total) trans 8589934634 rc 301/301 00000100:00100000:3.0:1788305805.917732:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 72 00000100:00100000:0.0:1788305805.926083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305805.928997:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994281600 00000100:00100000:2.0:1788305805.929017:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994281600 00000100:00100000:2.0:1788305805.929128:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:2.0:1788305805.929141:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15718:x1875173994281600:12345-192.168.202.55@tcp:34:lfs.0 00010000:00010000:2.0:1788305805.929251:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929335:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929354:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929377:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929385:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929392:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929505:0:17152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929515:0:17152:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929522:0:17152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788305805.929580:0:17152:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929595:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929601:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929618:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929624:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eb200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.929629:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929637:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929651:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8890825b9000) 00010000:00010000:2.0:1788305805.929654:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.929659:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929665:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eb200/0x4a426866e6054ea4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929681:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929687:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929692:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929696:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3ea200 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.929699:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929713:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929721:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff88918324a100) 00010000:00010000:2.0:1788305805.929723:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.929726:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.929731:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3ea200/0x4a426866e6054eab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932436:0:17152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932456:0:17152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932464:0:17152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932470:0:17152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8891bb3eba00 already unused, calling callback (ffffffffc19c54f0) 00010000:00010000:2.0:1788305805.932475:0:17152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932483:0:17152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932502:0:17152:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8890825b9100) 00010000:00010000:2.0:1788305805.932505:0:17152:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788305805.932509:0:17152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788305805.932539:0:17152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8891bb3eba00/0x4a426866e6054eb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788305805.932669:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff88918caa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15718:x1875173994281600:12345-192.168.202.55@tcp:34:lfs.0 Request processed in 3525us (6594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305805.932682:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 73 00000100:00100000:2.0:1788305805.937889:0:3641:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:0.0:1788305805.938689:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994281856 00000100:00100000:0.0:1788305805.938704:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994281856 00000100:00100000:0.0:1788305805.938785:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 15 00000100:00100000:0.0:1788305805.938798:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891afb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+25:15718:x1875173994281856:12345-192.168.202.55@tcp:35:lfs.0 00000100:00100000:0.0:1788305805.939123:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891afb24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+26:15718:x1875173994281856:12345-192.168.202.55@tcp:35:lfs.0 Request processed in 327us (1248us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788305805.939133:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 15 00010000:00010000:1.0:1788305806.873100:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788305807.896573:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788305808.422873:0:20332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:3.0:1788305808.514585:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305808.514617:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305808.514655:0:18664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994281984 00000100:00100000:3.0:1788305808.514665:0:18664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994281984 00002000:00100000:3.0:1788305808.514716:0:18664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff889184026680 x1875173994281984/t0(0) o4->0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp:739/0 lens 504/0 e 0 to 0 dl 1788305819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788305808.514726:0:18664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184026680 with x1875173994281984 ext(0->8) 00002000:00010000:3.0:1788305808.514731:0:18664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff889184026680 00000100:00100000:3.0:1788305808.514753:0:18664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 0 00000100:00100000:3.0:1788305808.514762:0:18664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+8:2395:x1875173994281984:12345-192.168.202.55@tcp:4:bash.0 00000100:00080000:2.0:1788305808.514879:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305808.525967:0:18664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184026680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+10:2395:x1875173994281984:12345-192.168.202.55@tcp:4:bash.0 Request processed in 11193us (11377us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788305808.525982:0:18664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 0 00002000:00100000:3.0:1788305808.525995:0:18664:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff889184026680 x1875173994281984/t8589934599(0) o4->0f32c93b-849d-4ca6-ae0d-05edb696d5c1@192.168.202.55@tcp:739/0 lens 504/448 e 0 to 0 dl 1788305819 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788305808.526007:0:18664:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff889184026680 with x1875173994281984 ext(0->8) 00002000:00010000:3.0:1788305808.526014:0:18664:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff889184026680 00000100:00100000:3.0:1788305808.526066:0:18661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282112 00000100:00100000:3.0:1788305808.526075:0:18661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282112 00000100:00100000:3.0:1788305808.526115:0:18661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 33 00000100:00100000:3.0:1788305808.526124:0:18661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+10:2395:x1875173994282112:12345-192.168.202.55@tcp:16:kworker.0 00000001:00080000:1.0:1788305808.540770:0:19473:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788305808.540786:0:19473:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:0.0:1788305808.540984:0:18661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184027800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+6:2395:x1875173994282112:12345-192.168.202.55@tcp:16:kworker.0 Request processed in 14854us (26359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305808.540995:0:18661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 33 00010000:00010000:1.0:1788305808.917575:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788305809.365928:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305809.365965:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891afb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015329152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305809.366041:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788305809.366201:0:20294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329152 00000100:00100000:2.0:1788305809.366209:0:20294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329152 00000100:00100000:2.0:1788305809.366307:0:20294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788305809.366319:0:20294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015329152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788305809.366350:0:20294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788305809.366394:0:20294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015329152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305809.366401:0:20294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788305809.366670:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788305809.366706:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891afb26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015329152:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788305809.521368:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305809.521416:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305809.521449:0:3642:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:2.0:1788305809.521562:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282240 00000100:00100000:2.0:1788305809.521572:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282240 00000100:00100000:2.0:1788305809.521629:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:2.0:1788305809.521640:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2397:x1875173994282240:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:2.0:1788305809.521706:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f38dbe3c-89d2-4155-8e7f-a4033c74b7ae+13:2397:x1875173994282240:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 68us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788305809.521715:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 171 00000100:00100000:0.0:1788305809.521882:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282496 00000100:00100000:0.0:1788305809.521887:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282496 00000100:00100000:0.0:1788305809.521934:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282368 00000100:00100000:0.0:1788305809.521937:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282368 00000100:00100000:0.0:1788305809.521956:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:0.0:1788305809.521964:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2397:x1875173994282496:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305809.522006:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889184025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2397:x1875173994282496:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 43us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305809.522013:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 81 00000100:00100000:0.0:1788305809.522026:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00100000:0.0:1788305809.522032:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+26:2397:x1875173994282368:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305809.522060:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891bb095180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+26:2397:x1875173994282368:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305809.522085:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 82 00000100:00080000:2.0:1788305809.522218:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788305809.522222:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788305809.554772:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305809.554808:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305809.554904:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:3.0:1788305809.554996:0:18928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282624 00000100:00100000:3.0:1788305809.555006:0:18928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282624 00000100:00100000:3.0:1788305809.555080:0:18928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 34 00000100:00100000:3.0:1788305809.555091:0:18928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+5:2394:x1875173994282624:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305809.555135:0:18928:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b08 00000100:00080000:3.0:1788305809.555161:0:18928:0:(import.c:65:import_set_state_nolock()) ffff8891b998d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305809.555223:0:18928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788305809.555412:0:18928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0f32c93b-849d-4ca6-ae0d-05edb696d5c1+2:2394:x1875173994282624:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 321us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305809.555420:0:18928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 34 00010000:00010000:3.0:1788305809.555474:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788305809.557140:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305809.562884:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305809.562913:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.55@tcp (source: 12345-192.168.202.55@tcp) 00000100:00100000:1.0:1788305809.562940:0:20293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283008 00000100:00100000:1.0:1788305809.562949:0:20293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283008 00000100:00100000:3.0:1788305809.563344:0:18660:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994283136 00000100:00100000:3.0:1788305809.563349:0:18660:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994283136 00000100:00100000:3.0:1788305809.563392:0:18660:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 35 00000100:00100000:3.0:1788305809.563401:0:18660:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2394:x1875173994283136:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:3.0:1788305809.563430:0:18660:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b4e 00000100:00080000:3.0:1788305809.563445:0:18660:0:(import.c:65:import_set_state_nolock()) ffff8891bd75c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788305809.563487:0:18660:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788305809.563639:0:18660:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+2:2394:x1875173994283136:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 239us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305809.563662:0:18660:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 35 00010000:00010000:3.0:1788305809.563829:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305809.565101:0:20293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:1.0:1788305809.565119:0:20293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2394:x1875173994283008:12345-192.168.202.55@tcp:9:kworker.0 00000020:00000080:1.0:1788305809.565148:0:20293:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x4a426866e6054b47 00000100:00080000:1.0:1788305809.565156:0:20293:0:(import.c:65:import_set_state_nolock()) ffff8891bd75f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788305809.565214:0:20293:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:3.0:1788305809.565345:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788305809.565350:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788305809.565366:0:17141:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788305809.565370:0:20293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:41b2c320-efb9-4bcd-bd61-e9037c280b63+2:2394:x1875173994283008:12345-192.168.202.55@tcp:9:kworker.0 Request processed in 259us (2493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305809.565377:0:20293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 36 00000100:00100000:0.0:1788305809.570839:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282752 00000100:00100000:0.0:1788305809.570865:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282752 00000100:00100000:0.0:1788305809.570961:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875173994282880 00000100:00100000:0.0:1788305809.570965:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875173994282880 00000100:00100000:1.0:1788305809.571205:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00100000:1.0:1788305809.571219:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2398:x1875173994282752:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:1.0:1788305809.571329:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:41b2c320-efb9-4bcd-bd61-e9037c280b63+6:2398:x1875173994282752:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 115us (16520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305809.571336:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 83 00000100:00080000:3.0:1788305809.571955:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788305809.571961:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788305809.573355:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.55@tcp, seq: 84 00000100:00100000:0.0:1788305809.573370:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2397:x1875173994282880:12345-192.168.202.55@tcp:400:kworker.0 00000100:00100000:0.0:1788305809.573442:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:41b2c320-efb9-4bcd-bd61-e9037c280b63+5:2397:x1875173994282880:12345-192.168.202.55@tcp:400:kworker.0 Request processed in 77us (18537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788305809.573450:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.55@tcp, seq: 84 00010000:00010000:3.0:1788305809.946028:0:17140:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788305810.198587:0:17905:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788305810.390602:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015329280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788305810.390669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.390731:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015329536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305810.390757:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.390775:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788305810.390780:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015329408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305810.390801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.390829:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329280 00000100:00100000:3.0:1788305810.390835:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329280 00000100:00100000:3.0:1788305810.390883:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329408 00000100:00100000:3.0:1788305810.390887:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329408 00000100:00100000:3.0:1788305810.390903:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305810.390912:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015329280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788305810.390938:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305810.390979:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015329280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.390986:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305810.391004:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305810.391019:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015329408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788305810.391029:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788305810.391057:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1875174015329408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.391063:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788305810.391083:0:17894:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329536 00000100:00100000:3.0:1788305810.391087:0:17894:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329536 00000100:00100000:3.0:1788305810.391112:0:17894:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788305810.391119:0:17894:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015329536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788305810.391142:0:17894:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788305810.391172:0:17894:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1875174015329536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.391178:0:17894:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788305810.391197:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788305810.391226:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:3.0:1788305810.391231:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8891903d6300, transno 8589934596 00000004:00080000:3.0:1788305810.391241:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788305810.391299:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb22a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3650:1875174015329408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788305810.391315:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082386a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3650:1875174015329536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788305810.391343:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891bb097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015329280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788305810.391488:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015329664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788305810.391521:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788305810.391652:0:18662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329664 00000100:00100000:1.0:1788305810.391656:0:18662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329664 00000100:00100000:1.0:1788305810.391686:0:18662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788305810.391693:0:18662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015329664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788305810.391703:0:18662:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788305810.391735:0:18662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891903d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875174015329664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305810.391741:0:18662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788305810.391756:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788305810.391775:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3647:1875174015329664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788305810.399344:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015329792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788305810.399435:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.399583:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015329920:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.399615:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.399652:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329920 00000100:00100000:3.0:1788305810.399667:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329920 00000100:00100000:3.0:1788305810.399722:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788305810.399734:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015329920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.399799:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8891b2c28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:739dca1e-bd16-46de-8d05-a6337c8af843+24:3649:x1875174015329920:12345-0@lo:400:kworker.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.399806:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788305810.399857:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:739dca1e-bd16-46de-8d05-a6337c8af843:3649:1875174015329920:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.399899:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015330048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.399927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.399959:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330048 00000100:00100000:3.0:1788305810.399963:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330048 00000100:00100000:3.0:1788305810.399991:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305810.399998:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015330048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400040:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1875174015330048:12345-0@lo:400:kworker.0 Request processed in 43us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.400046:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788305810.400078:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3650:1875174015330048:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400112:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305810.400122:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015330176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.400185:0:18658:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330176 00000100:00100000:3.0:1788305810.400188:0:18658:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330176 00000100:00100000:3.0:1788305810.400218:0:18658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305810.400227:0:18658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015330176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400264:0:18658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875174015330176:12345-0@lo:400:kworker.0 Request processed in 40us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.400320:0:18658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788305810.400358:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3648:1875174015330176:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400391:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015330304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400416:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.400443:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330304 00000100:00100000:3.0:1788305810.400447:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330304 00000100:00100000:3.0:1788305810.400470:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788305810.400477:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015330304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400513:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875174015330304:12345-0@lo:400:kworker.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.400519:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788305810.400542:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875174015330304:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400570:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015330432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400591:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.400613:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330432 00000100:00100000:3.0:1788305810.400617:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330432 00000100:00100000:3.0:1788305810.400644:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788305810.400650:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015330432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400681:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1875174015330432:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.400691:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788305810.400709:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305810.400733:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3649:1875174015330432:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400769:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015330560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400805:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.400831:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330560 00000100:00100000:3.0:1788305810.400835:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330560 00000100:00100000:3.0:1788305810.400861:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788305810.400867:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015330560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400900:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1875174015330560:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.400905:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788305810.400919:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788305810.400940:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082385f80 x1875174015330560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305810.400952:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3650:1875174015330560:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.400978:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788305810.400984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015330688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.401013:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.401036:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330688 00000100:00100000:3.0:1788305810.401039:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330688 00000100:00100000:3.0:1788305810.401069:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788305810.401076:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015330688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.401107:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875174015330688:12345-0@lo:400:kworker.0 Request processed in 31us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.401113:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788305810.401130:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788305810.401151:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3648:1875174015330688:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.401185:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015330816:0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.401224:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788305810.401251:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015330816 00000100:00100000:3.0:1788305810.401258:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015330816 00000100:00100000:3.0:1788305810.401319:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788305810.401328:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015330816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788305810.401365:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875174015330816:12345-0@lo:400:kworker.0 Request processed in 35us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788305810.401371:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788305810.401385:0:17148:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788305810.401403:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff889082385f80 x1875174015330816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788305826 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788305810.401413:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff889082385f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3648:1875174015330816:0@lo:400:kworker.0 00000100:00100000:1.0:1788305810.402041:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875174015329792 00000100:00100000:1.0:1788305810.402048:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875174015329792 00000100:00100000:1.0:1788305810.402090:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788305810.402098:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff889082386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015329792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788305810.402133:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788305810.402192:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff889082386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875174015329792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (2757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788305810.402201:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788305810.402239:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8891903d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3648:1875174015329792:0@lo:41:osp-pre-1-0.0 Debug log: 43708 lines, 43708 kept, 0 dropped, 0 bad.